Skip to content

Read each K/V byte once in gqa-8 decode attention - #4077

Merged
zcbenz merged 3 commits into
ml-explore:mainfrom
dudududukim:du-sdpa-gqa
Aug 18, 2026
Merged

zcbenz merged 3 commits into
ml-explore:mainfrom
dudududukim:du-sdpa-gqa