Refactor batch size handling for offloading host operations to device#1214

DocShotgun wants to merge 2 commits into

ikawrakow:mainikawrakow/ik_llama.cpp:mainfrom

DocShotgun:ggml-op-offload-min-batchCopy head branch name to clipboard