Skip to content

ggml-hrx: Q2_0 prompt matmuls on the int8 q8_1 x4 WMMA kernel (pp512 156 -> 323) - #79

Closed
bong-water-water-bong wants to merge 3 commits into
1bit/hrx-nvfp4-prefillfrom
1bit/hrx-q2_0-prefill
Closed

ggml-hrx: Q2_0 prompt matmuls on the int8 q8_1 x4 WMMA kernel (pp512 156 -> 323)#79
bong-water-water-bong wants to merge 3 commits into
1bit/hrx-nvfp4-prefillfrom
1bit/hrx-q2_0-prefill

tests: test-hrx-q2_0-prefill, known-answer and CPU checks of the Q2_0…

454ad02
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar