Skip to content

Add --prefetch-experts to stream mmap'd MoE experts into page cache#2101

Merged
ikawrakow merged 6 commits into
ikawrakow:mainfrom
dmaivel:moe-prefetch
Jul 11, 2026
Merged

Add --prefetch-experts to stream mmap'd MoE experts into page cache#2101
ikawrakow merged 6 commits into
ikawrakow:mainfrom
dmaivel:moe-prefetch

Add --prefetch-experts-threads, drop GGML_MOE_PREFETCH_THREADS env var

439c64b
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs