Skip to content

GgufLinear: inference-time GGUF matmul on Apple Silicon — llama.cpp parity - #45977

Closed
ArthurZucker wants to merge 32 commits into
mainfrom
gguf-matmul-kernels
Closed

GgufLinear: inference-time GGUF matmul on Apple Silicon — llama.cpp parity#45977
ArthurZucker wants to merge 32 commits into
mainfrom
gguf-matmul-kernels

serve: load GGUF models end-to-end

182d7aa
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar