Record: 10L Int6 QAT + Zstd MLP2.6x Muon0.99 Sliding Window (val_bpb 1.1598)#63

Merged

cocohearts merged 4 commits intoopenai:mainfrom

yahya010:submission/seq2048-fp16emb

Mar 20, 2026

Commits on Mar 19, 2026

Add Seq2048 + FP16 Tied Embedding submission (mean val_bpb 1.2067)

yahya010
and
claude
committed
Update submission: 10L + int6 mid + sliding window (mean val_bpb 1.1793)

yahya010
and
claude
committed
Update: full int6+zstd, MLP 1344, Muon 0.99 (mean val_bpb 1.1632)

yahya010
and
claude
committed
Update: STE int6 QAT, zero quant gap (mean val_bpb 1.1598)

yahya010
and
claude
committed