Skip to content

Better TG performance for GQA models (CPU)#332

Merged
ikawrakow merged 3 commits into
mainfrom
ik/tg_tweaks
Apr 17, 2025
Merged

Better TG performance for GQA models (CPU)#332
ikawrakow merged 3 commits into
mainfrom
ik/tg_tweaks

Minor

3e41c56
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs