CUDA: quantized GEMM for for IQ2_KS, IQ2_K, IQ3_K#418

ikawrakow merged 5 commits into

mainikawrakow/ik_llama.cpp:mainfrom

ik/cuda_mmq_iq2_kikawrakow/ik_llama.cpp:ik/cuda_mmq_iq2_kCopy head branch name to clipboard