Is it possible to run the captioning model with WD1.4 tagger?

SillyTavern / SillyTavern-Extras

Extensions API for SillyTavern.

GNU Affero General Public License v3.0

563 stars 133 forks source link

Is it possible to run the captioning model with WD1.4 tagger? #29

Open trihardseven opened 1 year ago

trihardseven commented 1 year ago

Such as this one: https://huggingface.co/SmilingWolf/wd-v1-4-swinv2-tagger-v2 It's a lot better than the default one, but I'm not sure how to make it run on the extension. --enable-modules=caption --captioning-model=SmilingWolf/wd-v1-4-swinv2-tagger-v2 gives errors like this OSError: SmilingWolf/wd-v1-4-swinv2-tagger-v2 does not appear to have a file named config.json. Checkout 'https://huggingface.co/SmilingWolf/wd-v1-4-swinv2-tagger-v2/main' for available files.

Cohee1207 commented 1 year ago

This particular tagger won't work with our captioning system, currently, only the BLIP family is supported.