Skip to content

SP8192 + Gated Attention + NorMuon + Norm-PCT-Dropout + Legal TTT — val_bpb 1.0824#1520

Open
taka6745 wants to merge 1 commit intoopenai:mainfrom
taka6745:submission/gated-attention-normuon-ttt
Open

SP8192 + Gated Attention + NorMuon + Norm-PCT-Dropout + Legal TTT — val_bpb 1.0824#1520
taka6745 wants to merge 1 commit intoopenai:mainfrom
taka6745:submission/gated-attention-normuon-ttt

Commits