Repository navigation

Speed up QMM & QMV - #4781

Open

XXXXRT666 wants to merge 6 commits into

ml-explore:mainfrom

XXXXRT666:metal-nax-quantized-mid-rows

Open

Speed up QMM & QMV#4781
XXXXRT666 wants to merge 6 commits into
ml-explore:mainfrom
XXXXRT666:metal-nax-quantized-mid-rows

Commits on Oct 30, 2026
- [Metal] Add gpu_core_count
  XXXXRT666
  committed
  cca4dd4
- [Metal] Add NAX split-K route for fp quantized matmul
  XXXXRT666
  committed
  97f2fcc
- [Metal] Add staged schedule for fp qmm_t_nax
  XXXXRT666
  committed
  d73d543
- [Metal] Use qmv_nax for narrower fp shapes
  XXXXRT666
  committed
  5158597
- [Metal] Scale NAX split-K partitions with GPU core count
  XXXXRT666
  committed
  2da2240
- [Metal] Add affine qmv_nax for few rows
  XXXXRT666
  committed
  ccd10cc