Non-record: Nemotron-H Mamba-3 Hybrid + First SSM Depth Recurrence (1.4765 BPB)#1607

Open

inin-zou wants to merge 150 commits intoopenai:mainfrom

inin-zou:submission/nemotron-h-mamba3-depth-recurrence

Commits on Mar 18, 2026

Commits on Mar 19, 2026

Commits on Mar 20, 2026

Commits on Mar 21, 2026

Commits on Mar 22, 2026

Record: 11L EMA + GPTQ-lite + warmdown3500 + QAT@0.15 (val_bpb=1.1233, 3-seed mean)
signalrush
committed

Commits on Mar 23, 2026

Record: LeakyReLU² + Legal TTT + Parallel Muon — val_bpb 1.1194 (3-seed mean)

abaybektursun
and
claude
committed
Fix pre-TTT BPB, TTT gains, and steps to match logs exactly
abaybektursun
committed
Fix author attributions: PR #493 @parinzee, PR #461 @Christopher-Lee-McClendon
abaybektursun
committed
Merge pull request #265 from unnir/submission/v22-XSA3-beats-top1
cocohearts
authored
Merge pull request #287 from jfprincz/submission/11l-xsa4-ema-int6-mlp3x-wd04-1.1271
cocohearts
authored
Merge pull request #315 from jfprincz/submission/11l-partialrope-lateqat-1.1248
cocohearts
authored
Merge pull request #414 from signalrush/submission/ema-gptqlite-1.1233
cocohearts
authored
Update README leaderboard with merged records
cocohearts
committed
Use GitHub usernames in new leaderboard rows
cocohearts
committed
Describe leaderboard entries by base-run diff
cocohearts
committed
Merge pull request #561 from openai/codex/update-readme-leaderboard-merged-records
cocohearts
authored

Commits on Mar 25, 2026

Commits on Mar 28, 2026

Record: AR Self-Gen GPTQ + XSA-all + BigramHash 3072×112 — val_bpb 1.11473 (3-seed mean)

abaybektursun
and
claude
committed

Commits on Mar 30, 2026

Commits on Mar 31, 2026

Commits on Apr 2, 2026

Add train_gpt.py to submission
msisovic
committed

Commits on Apr 3, 2026

Record: MuonEq-R + Depth Recurrence + WD=0.090 + All-Int6 — val_bpb 1.0912 (3-seed mean)
dexhunter
committed

Commits on Apr 4, 2026

Record: SP4096 + Depth Recurrence + Parallel Residuals + MuonEq-R — val_bpb 1.0897 (3-seed mean)
aryanbhosale
committed

Commits on Apr 5, 2026

Record: SP8192 + GPTQ Embeddings + SDClip + Loop45x2 — val_bpb 1.08563 (5-seed mean)
clarkkev
committed

Commits on Apr 6, 2026

Commits on Apr 8, 2026

Record: SP8192 + Parallel Residuals + Score-First TTT — val_bpb 1.0822 (3-seed mean)
aryanbhosale
committed

Commits on Apr 9, 2026

Commits on Apr 14, 2026

Non-record: Nemotron-H Mamba-3 Hybrid + Hinge Point Depth Recurrence (1.4765 BPB)

inin-zou
and
claude
committed