Skip to content

Allow for all layers in Qwen3.5 architecture to be Gated Deltanet. - #45148

Closed
HallerPatrick wants to merge 2 commits into
huggingface:mainfrom
HallerPatrick:main
Closed

Allow for all layers in Qwen3.5 architecture to be Gated Deltanet.#45148
HallerPatrick wants to merge 2 commits into
huggingface:mainfrom
HallerPatrick:main

Change attention type check from softmax to full attention

a947401
Select commit
Loading
Failed to load commit list.
CircleCI Checks / setup_and_quality failed Mar 31, 2026 in 1m 52s

Workflow: setup_and_quality

View CircleCI Workflow

View more details on CircleCI Checks