Skip to content

Faster MLA prompt processing#205

Merged
ikawrakow merged 8 commits into
mainfrom
ik/mla_fixes
Feb 13, 2025
Merged

Faster MLA prompt processing#205
ikawrakow merged 8 commits into
mainfrom
ik/mla_fixes

MLA: compile time option to not use transposed KV cache

f875ed0
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs