Repository navigation

vulkan: Dynamic subgroup size support for Q6_K mat_vec - #10536

Merged

0cc4m merged 6 commits into

ggml-org:masterfrom

netrunnereve:vulkan

Nov 30, 2024

Merged

vulkan: Dynamic subgroup size support for Q6_K mat_vec#10536
0cc4m merged 6 commits into
ggml-org:masterfrom
netrunnereve:vulkan

Commits on Nov 27, 2024
- subgroup 64 version with subgroup add. 15% faster
  netrunnereve
  committed
  0aa5fd0
Commits on Nov 28, 2024
Commits on Nov 30, 2024
- make 16 subgroup size a constant
  netrunnereve
  committed
  b65961b