pytti-tools / pytti-book

PyTTI Documentation and Tutorials
https://pytti-tools.github.io/pytti-book/intro.html
36 stars 10 forks source link

[TUTORIAL] BLIP image prompt stabilization #24

Open dmarx opened 2 years ago

dmarx commented 2 years ago

this would be an advanced tutorial, and might actually require some feature development to be realizable.

consider some image X we want to use as an image prompt. run automated captioning on it repeatedly and project the sampled text captions into CLIP space. use the resultant vectors as supplemental guiding CLIP prompts (or pooled into a single prompt prompts).