search

alex-moon / vc

MIT License
22 stars 6 forks source link

CLIP-guided diffusion #37

Open alex-moon opened 2 years ago

alex-moon commented 2 years ago

Results from CGD appear to better than those from vqganclip. Investigate and implement!

Check out this colab from Crowson: https://colab.research.google.com/drive/1mpkrhOjoyzPeSWy2r7T8EYRaU7amYOOi?s=09 or https://colab.research.google.com/drive/1uGKaBOEACeinAA7jX1_zSFtj_ZW-huHS?s=09

Also Nerdy Rodent has a repo: https://github.com/nerdyrodent/CLIP-Guided-Diffusion

Might be kind to make a PR to this repo with changes from the updated colabs...

alex-moon commented 2 years ago

OK lots of options. Let's try the Crowson colab 256x256 first.

alex-moon commented 2 years ago

Using the nerdyrodent one would be easier btw.

alex-moon commented 2 years ago

Preliminary results are not promising. CGD doesn't like complex prompts.