Skip to content

Support attention bias with windowed CPU GQA - #32302

Merged
Tianlei Wu (tianleiwu) merged 2 commits into
mainfrom
tlwu/gqa_windowed_cache_att_bias
Aug 31, 2026
Merged

Tianlei Wu (tianleiwu) merged 2 commits into
mainfrom
tlwu/gqa_windowed_cache_att_bias

Commits

Commits on Aug 28, 2026