jhc13 / taggui

Tag manager and captioner for image datasets
GNU General Public License v3.0
495 stars 26 forks source link

Variable {tags} not working with Florence 2 #213

Closed BenDes21 closed 2 weeks ago

BenDes21 commented 2 weeks ago

Hi there

I don't know if its possible, but I would like push Florence 2 ( which is, as cogvlm, too censored ) to use the " banned " tags generated by wd tagger.

I generated first the tags with wd tagger then switch to Florence 2 and insert the variable {tags} into the field " include in caption "

Problem is that instead of my tags, it's the name of variable so '{tags}' who is include.

Here a screen :

Untitled

Thanks a lot

jhc13 commented 2 weeks ago

It's not a problem with Florence-2. Include in caption does not support template variables like {tags}.

BenDes21 commented 2 weeks ago

It's not a problem with Florence-2. Include in caption does not support template variables like {tags}.

do you think Include in caption will be able to support template variable in the next update ?

jhc13 commented 2 weeks ago

No. That wouldn't make sense (too many tags to include), and Include in caption doesn't work well most of the time so it's not recommended to use it anyway.

BenDes21 commented 2 weeks ago

No. That wouldn't make sense (too many tags to include), and Include in caption doesn't work well most of the time so it's not recommended to use it anyway.

ok ! If you know a way to break the censorship of florence 2 let me know, I heard that it's possible to finetune model for allow more explicit vocabulary but I dont see much documentation on it