search

huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
24.27k stars 5.01k forks source link

Pixart with Controllnet #6048

Open Aziily opened 7 months ago

Aziily commented 7 months ago

Model/Pipeline/Scheduler description

Hello, thanks a lot for your great job.

However, I am wondering to use pixart with a extended constrain like controlnet's canny, but it seems that there is no such pipeline though shown on Pixart's github page. Will you plan to add this pipeline, or this will be proceeded after the release of Pixart's controlnet code?

Open source status

Provide useful links for the implementation

No response

sayakpaul commented 7 months ago

Cc: @lawrence-cj

sayakpaul commented 7 months ago

Sure, but do we have existing checkpoints for PixArt-Alpha and ControlNet?

Cc: @lawrence-cj

lawrence-cj commented 7 months ago

Currently, there is no PIxArt-alpha + ControlNet ckpt in public. We are also working on exploring more reasonable ControlNet for Transformer structure.

github-actions[bot] commented 6 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

Satyajitv commented 5 months ago

@sayakpaul @a-r-r-o-w now that the checkpoints are available, would like to work on a PR for this one. Going to use https://github.com/huggingface/diffusers/pull/5928 for reference.

sayakpaul commented 5 months ago

Feel free to.

github-actions[bot] commented 4 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.