Skip to content

cuda: reserve space for quantize kv-cache at startup#23907

Merged
am17an merged 4 commits into
ggml-org:masterfrom
am17an:fattn-static-kv-cache
Jun 3, 2026
Merged

cuda: reserve space for quantize kv-cache at startup#23907
am17an merged 4 commits into
ggml-org:masterfrom
am17an:fattn-static-kv-cache

remove assert in ggml-cuda.cu

b324987
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
labeler
succeeded May 31, 2026 in 11s