divamgupta / stable-diffusion-tensorflow

Stable Diffusion in TensorFlow / Keras
Other
1.57k stars 227 forks source link

Update README.md Adding a Colab video generation notebook #53

Closed costiash closed 1 year ago

costiash commented 1 year ago

Hello, as I found the implementation of Stable Diffusion in this repo to be my favorite in terms of the ease of setting up and creating Colab notebooks, inspired by the Deforum Stable Diffusion Notebook for creating video animation using Stable Diffusion models, I have implemented a Keras Stable Diffusion Colab notebook for creating video animations using all the great features that this repo has to offer including: Jit Compilation, Mixed Precision Policy, loading new pytorch weights directly from Hugging Face and using the ability of passing to the generator images as input via iterating process.  The primary goal was to create as user-friendly and informative a notebook as possible, especially for those who are unfamiliar with the amazing world of text-to-image generation. The notebook is entirely based on the implementation of this repo, and was heavily influenced by the work-flow of the Deforum Stable Diffusion notebook. I hope you find this contribution does seem to be appropriate for acceptance in the main repo. @divamgupta

divamgupta commented 1 year ago

Thanks for the PR. Maybe you can create stable_diffusion_tf/video_utils.py with the functions to generate video. And call those functions from the notebook.

costiash commented 1 year ago

yes sure np. will comment here when it's ready and the functionality is checked

costiash commented 1 year ago

Hi @divamgupta added the video_utils.py file and updated the colab demo accordingly