Skip to content

[MiniMax-M3.1] NVFP4 KV cache and index cache (--kv-cache-dtype nvfp4, --index-cache-dtype nvfp4) - #3310

Open
ganyi1996ppo wants to merge 6 commits into
mainfrom
ganyi/m31-nvfp4-kv-index
Open

ganyi1996ppo wants to merge 6 commits into
mainfrom
ganyi/m31-nvfp4-kv-index

M3.1 nvfp4: follow aiter's rename of the sparse PA ops to sparse_pa_n…

2421500
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar