Acly / krita-ai-diffusion

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.
GNU General Public License v3.0
5.55k stars 245 forks source link

IDEA: Image to Text (Auto prompt) #829

Closed b4zz4 closed 1 week ago

b4zz4 commented 1 week ago

Prompt autogenerator and not prompt. This is very useful to know that you see clip in the image and be able to modify it.

Acly commented 1 week ago

This is very useful to know that you see clip in the image and be able to modify it.

That's not really how it works.

But there is #372 which is same request I think. The solutions at the time were quite bad. Now you can use Florence-2 maybe, but I haven't tried yet.

b4zz4 commented 1 week ago

I don't know if it's the same, I think it could generate a text description of the picture given as input. This is good to understand that it interprets the AI of the image.

Similar: https://huggingface.co/spaces/pharmapsychotic/CLIP-Interrogator