Skip to content

[webgpu] Fix GatherBlockQuantized on Intel ADL/TGL platforms - #26526

Merged
Guenther Schmuelling (guschmue) merged 3 commits into
microsoft:mainfrom
daijh:fix-gather-int4
Nov 13, 2025
Merged

[webgpu] Fix GatherBlockQuantized on Intel ADL/TGL platforms#26526
Guenther Schmuelling (guschmue) merged 3 commits into
microsoft:mainfrom
daijh:fix-gather-int4

Conversation

@daijh

Copy link
Copy Markdown
Contributor

Description

The GatherBlockQuantized operation was using incorrect data_indices during execution on Intel Alder Lake (ADL) and Tiger Lake (TGL) platforms.

This change sets the proper data_indices, resolving correctness issues encountered with the Phi-4-mini model on these architectures.

Motivation and Context

See above.

@daijh

Copy link
Copy Markdown
Contributor Author

The first commit is only the early draft to demonstrate the fixing.
To be refined in following commits.

@daijh

Copy link
Copy Markdown
Contributor Author

@fs-eire

Copy link
Copy Markdown
Contributor

Thanks for the fix! LGTM

Comment thread onnxruntime/contrib_ops/webgpu/quantization/gather_block_quantized.cc Outdated
@fs-eire

Copy link
Copy Markdown
Contributor

/azp run Linux QNN CI Pipeline, Win_TRT_Minimal_CUDA_Test_CI, Windows ARM64 QNN CI Pipeline, Windows GPU Doc Gen CI Pipeline

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 4 pipeline(s).

@guschmue

Copy link
Copy Markdown
Contributor

tested on tgl with qwen3-0.6b and int4 embeddings - works!

@daijh

Copy link
Copy Markdown
Contributor Author

Not sure why CI failed. Probably kick off a retry.

@guschmue

Copy link
Copy Markdown
Contributor

/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 4 pipeline(s).

@guschmue

Copy link
Copy Markdown
Contributor

/azp run web_Release / build_onnxruntime_web,web_Debug / build_onnxruntime_web,Test Linux TensorRT x64 Release,Test Linux CUDA x64 Release

@azure-pipelines

Copy link
Copy Markdown
No pipelines are associated with this pull request.

@guschmue
Guenther Schmuelling (guschmue) merged commit d6219b6 into microsoft:main Nov 13, 2025
157 of 184 checks passed
@daijh
Jianhui Dai (daijh) deleted the fix-gather-int4 branch November 18, 2025 11:06
Rohanjames1997 pushed a commit to Rohanjames1997/onnxruntime that referenced this pull request Dec 4, 2025
…soft#26526)

### Description
The `GatherBlockQuantized` operation was using incorrect `data_indices`
during execution on Intel Alder Lake (ADL) and Tiger Lake (TGL)
platforms.

This change sets the proper `data_indices`, resolving correctness issues
encountered with the Phi-4-mini model on these architectures.


### Motivation and Context
See above.
Sumit Kumar (Sumit2318) pushed a commit that referenced this pull request Jan 6, 2026
### Description
The `GatherBlockQuantized` operation was using incorrect `data_indices`
during execution on Intel Alder Lake (ADL) and Tiger Lake (TGL)
platforms.

This change sets the proper `data_indices`, resolving correctness issues
encountered with the Phi-4-mini model on these architectures.


### Motivation and Context
See above.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ep:WebGPU ort-web webgpu provider

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants