search

william-murray1204 / stable-diffusion-cpp-python

stable-diffusion.cpp bindings for python
MIT License
20 stars 2 forks source link

Any plans to support video generation? #4

Open mirix opened 4 days ago

mirix commented 4 days ago

Any plans to support video generation?

I don't know if this is even remotely related to the SD architecture:

https://huggingface.co/genmo/mochi-1-preview

https://huggingface.co/Kijai/Mochi_preview_comfy/tree/main

william-murray1204 commented 3 days ago

Hi @mirix, as this project only provides Python bindings for @leejet's stable-diffusion.cpp library, video generation (of any kind) will first need to be supported in that library. Once it's working there, you’ll be able to use it with this package.

It's worth noting there is an img2vid function in the stable-diffusion.cpp code (seen here), however I don't think it works.

Unfortunately im not familiar with the genmo/mochi-1-preview architecture so I cant really give you a good answer as to whether it has any similarity to SD. I'd suggest asking this question in the stable-diffusion.cpp repo, although it seems you already have anyway.