CUDA: fix scratch buffers being allocated on non-main device#3220

JohannesGaessler merged 1 commit intoggml-org:masterggml-org/llama.cpp:masterfrom

JohannesGaessler:cuda-fix-malloc-wrong-deviceJohannesGaessler/llama.cpp:cuda-fix-malloc-wrong-deviceCopy head branch name to clipboard