The video sampling can now be guided using CLIP prompts.
This seems to work pretty fast, so it's still a viable way to reduce a number of produced frames.
- adding CLIP-based gating for sampling
added docker build image
fixed some bugs in requirements and setup scripts
adding gif creation from sampled frames
added a notebook in notebooks to show the distribution shift of the sampled frames
added some basic tests (really basic)
added a short explanation and usage of guided sampling in README.md.
Description
The video sampling can now be guided using CLIP prompts. This seems to work pretty fast, so it's still a viable way to reduce a number of produced frames.
- adding CLIP-based gating for sampling
notebooksto show the distribution shift of the sampled frames