Non-record: LLM-JEPA — Joint Embedding Prediction (val_bpb 2.2020)#1196

Open

dentity007 wants to merge 3 commits intoopenai:mainfrom

NathanMaine:research/llm-jepa

Commits on Mar 31, 2026

Add approach notes for parameter golf challenge
dentity007
committed
Update approach with depth recurrence, factorized embeddings, tokenizer optimization, and SSM exploration
dentity007
committed
Non-record: LLM-JEPA — Joint Embedding Prediction (val_bpb 2.2020)

dentity007
and
claude
committed