Skip to content

Record: 4096-Vocab + 4.0-MLP-mult + 0.085-WD + Simplifications — val_bpb 1.09785 (3-seed mean)#1218

Merged
cocohearts merged 1 commit intoopenai:mainfrom
clarkkev:submission/vocab4096-mlpmult4-wd085
Apr 9, 2026
Merged

Record: 4096-Vocab + 4.0-MLP-mult + 0.085-WD + Simplifications — val_bpb 1.09785 (3-seed mean)#1218
cocohearts merged 1 commit intoopenai:mainfrom
clarkkev:submission/vocab4096-mlpmult4-wd085