Make prompt cache saving and restoring MLA aware#497

Merged

ikawrakow merged 6 commits into

mainfrom

s6/MLA_prompt_save_restore_fix

Jun 6, 2025

Commits on May 28, 2025

Remove kv_l, kvt_l and just use k_l and v_l
Iwan Kawrakow
committed
Hopefully take care of missing V cache (MLA)
Iwan Kawrakow
committed

Commits on May 30, 2025

Commits on Jun 6, 2025

Update write_kv_cache_data and read_kv_cache_data to be MLA aware
saood06
committed
Merge remote-tracking branch 'origin/main' into s6/MLA_prompt_save_restore_fix
saood06
committed