Skip to content

Record: 10L Int5-MLP + SmearGate + BigramHash + Late QAT (val_bpb=1.1628)#286

Open
chris-buckley wants to merge 1 commit intoopenai:mainfrom
chris-buckley:10l-int5mlp-smearbigram-lateqat
Open

Record: 10L Int5-MLP + SmearGate + BigramHash + Late QAT (val_bpb=1.1628)#286
chris-buckley wants to merge 1 commit intoopenai:mainfrom
chris-buckley:10l-int5mlp-smearbigram-lateqat

Commits

Commits on Mar 20, 2026