Skip to content

[MiniMax-M3.1] MXFP4 index cache and MXFP4 KV cache (--index-cache-dtype fp4, --kv-cache-dtype fp4) - #2962

Open
ganyi1996ppo wants to merge 90 commits into
mainfrom
ganyi/m31-mxfp4-main
Open

[MiniMax-M3.1] MXFP4 index cache and MXFP4 KV cache (--index-cache-dtype fp4, --kv-cache-dtype fp4)#2962
ganyi1996ppo wants to merge 90 commits into
mainfrom
ganyi/m31-mxfp4-main

Declare kv_layout once on the impl base; refuse MXFP4 KV under sequen…

ececbeb
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar