ouhenio / StyleGAN3-CLIP-notebooks

A collection of Jupyter notebooks to play with NVIDIA's StyleGAN3 and OpenAI's CLIP for a text-based guided image generation.
207 stars 19 forks source link
clip google-colab image-generation stylegan stylegan3

StyleGAN3 CLIP-based guidance

StyleGAN3 + CLIP

<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open in Colab" />

StyleGAN3 + inversion + CLIP

<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open in Colab" />


This repo is a collection of Jupyter notebooks made to easily play with StyleGAN3[^1] and CLIP[^2] for a text-based guided image generation.

Both notebooks are heavily based on this notebook, created by nshepperd (thank you!).

Special thanks too to Katherine Crowson for coming up with many improved sampling tricks, as well as some of the code.

[^1]: StyleGAN3 was created by NVIDIA. Here is the original repo.

[^2]: CLIP (Contrastive Language-Image Pre-Training) is a multimodal model made by OpenAI. For more information head over here.

Feel free to suggest any changes! If anyone has any idea what license should this repo use, please let me know.