Skip to content

Fix load of z-image-turbo#9264

Merged
mudler merged 2 commits intomudler:masterfrom
thelittlefireman:patch-1
Apr 11, 2026
Merged

Fix load of z-image-turbo#9264
mudler merged 2 commits intomudler:masterfrom
thelittlefireman:patch-1

Conversation

@thelittlefireman
Copy link
Copy Markdown
Contributor

Description

This PR fixes error on load z-image-turbo

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

@mudler mudler requested a review from richiejp April 7, 2026 13:02
Copy link
Copy Markdown
Collaborator

@richiejp richiejp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this! May have to drop the flash attention settings or else remove it when Intel is present.

- llm_path:Qwen3-4B.Q4_K_M.gguf
- vae_path:ae.safetensors
- offload_params_to_cpu:true
- diffusion_flash_attn:true
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately this is broken on Intel SYCL. I'm not sure how we want to handle this @mudler ?

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would suggest to ignore the option in the backend and detect intel usage there

- diffusion_flash_attn:true
parameters:
model: z_image_turbo-Q4_K.gguf
model: z_image_turbo-Q4_0.gguf
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks!

@thelittlefireman thelittlefireman changed the title Fix load of z-image and improve speed Fix load of z-image-turbo Apr 7, 2026
Signed-off-by: thelittlefireman <5165783+thelittlefireman@users.noreply.github.com>
Removed 'diffusion_flash_attn' parameter from configuration.

Signed-off-by: thelittlefireman <5165783+thelittlefireman@users.noreply.github.com>
@mudler mudler merged commit 7c1865b into mudler:master Apr 11, 2026
30 of 32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants