Skip to content

🚨Add an FP8 backend to QuantizedCache - #48677

Merged
vasqu merged 21 commits into
huggingface:mainfrom
jiqing-feng:fp8-kv-cache
Oct 22, 2026
Merged

🚨Add an FP8 backend to QuantizedCache#48677
vasqu merged 21 commits into
huggingface:mainfrom
jiqing-feng:fp8-kv-cache

Declare the quantized states in the base layer, and group the quantiz…

08c5bc7
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
security-gate / get-changed-files
succeeded Oct 22, 2026 in 8s