Non-record: Mamba-Inspired SSM Hybrid 3:1 (val_bpb 3.3168)#1197

Open

dentity007 wants to merge 3 commits intoopenai:mainfrom

NathanMaine:research/mamba-hybrid

Commits on Mar 31, 2026

Add approach notes for parameter golf challenge
dentity007
committed
Update approach with depth recurrence, factorized embeddings, tokenizer optimization, and SSM exploration
dentity007
committed
Non-record: Mamba-Inspired SSM Hybrid (3:1 SSM:Attention) (val_bpb 3.3168)

dentity007
and
claude
committed