search

AUTOMATIC1111 / stable-diffusion-webui-tokenizer

An extension for stable-diffusion-webui that adds a tab that lets you preview how CLIP model would tokenize your text.
146 stars 22 forks source link

fix issue 2 and add webui grammar parsing #4

Open zzhongzz opened 1 year ago

zzhongzz commented 1 year ago

This PR solve the highlights in dark mode (issue #2) and also provide parsing prompts by webui before tokenize. Some examples are as follow:

Simple tokenizer: image

Parse prompts by webui grammar before tokenize: at step 1: image

at step 50: image

Test "AND" keyword: block 0: image

block 2: image