Magcache Support.

[Meatfucker]

Id like to see magcache acceleration supported if possible. My own testing shows it to cut video generation times in half with almost no quality loss at all. It seems to be considerably better quality than something like teacache or more efficient attention mechanisms.

https://github.com/Zehong-Ma/MagCache

Kandinsky5 I2V Normal inference: 1168 seconds

The_chili_pepper_monster_explo.mp4

Kandinsky5 I2V Magcache Inference: 592 seconds

The_chili_pepper_monster_explo_copy.mp4

@leffff
@Zehong-Ma

[leffff]

Hi!
We have a MagCache version in our main repo.

@sayakpaul hiw can we integrate MagCache into Diffusers pipeline?

[sayakpaul]

We support a bunch of caching techniques in Diffusers:
https://huggingface.co/docs/diffusers/main/en/api/cache

I think we could ship MagCache in a similar manner. Good reference would be FirstBlock cache:
https://huggingface.co/docs/diffusers/main/en/api/cache#diffusers.FirstBlockCacheConfig

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.