Non-record: Olmo Hybrid (GDN + Attention) for long-context training — 8k/16k/32k crossover study#1371

Merged

valerio-oai merged 5 commits intoopenai:mainfrom

aarjunsrinivasan:gdn_long_context

May 3, 2026

Commits on Apr 3, 2026

gdn implementation
aarjunsrinivasan
committed

Commits on Apr 4, 2026

wrong file placement
Arjun Srinivasan Ambalam
committed

Commits on Apr 5, 2026

Add GDN hybrid and baseline model implementations

Arjun Srinivasan Ambalam
and
claude
committed
Add run scripts for hybrid and baseline long-context experiments

Arjun Srinivasan Ambalam
and
claude
committed
Add submission results, logs, and writeup for GDN Hybrid long-context

Arjun Srinivasan Ambalam
and
claude
committed