Commit 01eaf44
committed
Fix joint attention mask being applied on image-only self-attention
Only prepare and apply the joint attention mask when encoder_hidden_states
is present. SD3.5 dual-attention blocks pass joint_attention_kwargs (including
the text mask) to attn2 self-attention, which should ignore the mask.1 parent f41465a commit 01eaf44
1 file changed
Lines changed: 4 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1513 | 1513 | | |
1514 | 1514 | | |
1515 | 1515 | | |
1516 | | - | |
| 1516 | + | |
| 1517 | + | |
| 1518 | + | |
| 1519 | + | |
1517 | 1520 | | |
1518 | 1521 | | |
1519 | 1522 | | |
| |||
0 commit comments