Skip to content

[Spec decode] --spec-decode-kv-cache-dtype: bf16/fp8 KV for a draft that has its own pool - #3235

Open
ganyi1996ppo wants to merge 3 commits into
mainfrom
ganyi/m31-draft-kv-flag
Open

[Spec decode] --spec-decode-kv-cache-dtype: bf16/fp8 KV for a draft that has its own pool#3235
ganyi1996ppo wants to merge 3 commits into
mainfrom
ganyi/m31-draft-kv-flag

Commits

  1. Commits on Nov 12, 2026