Skip to content

Gemma 4 31B on QuietBox 2: the serving implementation (prefix caching, BF8, speculation, packed KV pool) - #65783

Draft
mvasiljevicTT wants to merge 19 commits into
mainfrom
mvasiljevic/gemma31b-pr-demo
Draft

mvasiljevicTT wants to merge 19 commits into
mainfrom
mvasiljevic/gemma31b-pr-demo

Commits

  1. Commits on Nov 15, 2026