[CUDA] Correct after_gather_dim for nibbled uint4 index - #26484

Merged

Tianlei Wu (tianleiwu) merged 6 commits into

mainfrom

jdeng/shared_4bit_emb

Nov 6, 2025

Commits on Oct 30, 2025

Matched after_gather_dim in gather_block_quantized to correct CUDA kernel indexing
Jixiong Deng (jixiongdeng)
committed
76d8632

Commits on Nov 6, 2025

Added general u8/i4x2 tests from @xiaomsft
Jixiong Deng (jixiongdeng)
committed
4092a09
Added UINT4X2 cases in Test_GatherAxis_WithZeroPoints_NoPading
Jixiong Deng (jixiongdeng)
committed
e37e5b9
Added test for uint8_t with two packed u4.
Jixiong Deng (jixiongdeng)
committed
d9d8a29
Added testcases that mimic usecase for shared emb_tokens/lm_head & Updated comments
Jixiong Deng (jixiongdeng)
committed
12a8bb2
Limited testcases to CUDA backend
Jixiong Deng (jixiongdeng)
committed
7aa39a2