Skip to content

Faster RoPE+QK-norm backwards and swtiching MLP learning rate multiplier#492

Closed
chrisjmccormick wants to merge 5 commits into
karpathy:masterfrom
chrisjmccormick:rope-chunk-mlp-lr
Closed

Faster RoPE+QK-norm backwards and swtiching MLP learning rate multiplier#492
chrisjmccormick wants to merge 5 commits into
karpathy:masterfrom
chrisjmccormick:rope-chunk-mlp-lr

Commits

Commits on Feb 2, 2026