Record: Sliding Window Eval, 2048 Vocab Size, fp16 embeddings, SWA, NorMuon, FA3; mean_val_bpb:1.160#122
Open
mtybadger wants to merge 2 commits intoopenai:mainfrom
Open
Record: Sliding Window Eval, 2048 Vocab Size, fp16 embeddings, SWA, NorMuon, FA3; mean_val_bpb:1.160#122mtybadger wants to merge 2 commits intoopenai:mainfrom
mtybadger wants to merge 2 commits intoopenai:mainfrom
Commits
Commits on Mar 19, 2026
- committed
Commits on Mar 20, 2026
- committed