AUTOMATIC1111 / stable-diffusion-webui-tokenizer

An extension for stable-diffusion-webui that adds a tab that lets you preview how CLIP model would tokenize your text.
153 stars 25 forks source link

Thanks! #1

Open 0xdevalias opened 2 years ago

0xdevalias commented 2 years ago

Haha, thanks for this!

I was literally doing some initial exploration work last night with the idea of making exactly this sort of thing!

Even better that I don't have to do it myself now! 🖤

illtellyoulater commented 2 years ago

I know this is a noob question but could you please explain in short why looking at the tokens can be so helpful?