Skip to content

[Non-Record] JEPA Self-Distillation with EMA Target Encoder for Autoregressive LM | Controlled A/B Shows No Gain Over Vanilla CE (val_bpb: 1.19)#896

Open
MVPandey wants to merge 5 commits intoopenai:mainfrom
MVPandey:main
Open

[Non-Record] JEPA Self-Distillation with EMA Target Encoder for Autoregressive LM | Controlled A/B Shows No Gain Over Vanilla CE (val_bpb: 1.19)#896
MVPandey wants to merge 5 commits intoopenai:mainfrom
MVPandey:main

Commits

Commits on Mar 26, 2026