Add --prefetch-experts to stream mmap'd MoE experts into page cache#2101

ikawrakow merged 6 commits into

ikawrakow:mainikawrakow/ik_llama.cpp:mainfrom

dmaivel:moe-prefetchdmaivel/ik_llama.cpp:moe-prefetchCopy head branch name to clipboard