Non-record: Fused Triton Megakernels — RMSNorm + LeakyReLU² (val_bpb 1.3560)#1192

Open

dentity007 wants to merge 3 commits intoopenai:mainfrom

NathanMaine:research/megakernels

Commits on Mar 31, 2026

Add approach notes for parameter golf challenge
dentity007
committed
Update approach with depth recurrence, factorized embeddings, tokenizer optimization, and SSM exploration
dentity007
committed
Non-record: Fused Triton Megakernels (val_bpb 1.3560)

dentity007
and
claude
committed