ggml-cuda : perform cublas mat mul of quantized types as f16 - #3412

ggml-cuda : perform cublas mat mul of quantized types as f16#3412

slaren merged 3 commits into

masterggml-org/llama.cpp:masterfrom

cublas-q-f16ggml-org/llama.cpp:cublas-q-f16Copy head branch name to clipboard