Repository navigation
Gemma 4 31B on QuietBox 2: the serving implementation (prefix caching, BF8, speculation, packed KV pool) - #65783
Draft
mvasiljevicTT wants to merge 19 commits into
Draft
mvasiljevicTT wants to merge 19 commits into
mvasiljevicTT wants to merge 19 commits into
Commits
Commits on Nov 15, 2026
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- andcommitted
- committed
Gemma 4 31B QB2: rebuild the interleaved prefill weights once per layer and span, not once per chunk
committed- andcommitted