Skip to content

Better TG performance for GQA models (CPU)#332

Merged
ikawrakow merged 3 commits into
mainfrom
ik/tg_tweaks
Apr 17, 2025
Merged

Better TG performance for GQA models (CPU)#332
ikawrakow merged 3 commits into
mainfrom
ik/tg_tweaks

Commits

Commits on Apr 16, 2025