cocktailpeanut / fluxgym

Dead simple FLUX LoRA training UI with LOW VRAM support
1.23k stars 101 forks source link

Caption Parsing is Fragile #64

Open Stoobs opened 1 month ago

Stoobs commented 1 month ago

The caption process seems to barf at any caption file I throw at fluxgym, normally any accented characters or "magic" quotes, even when converting the caption files to pure utf-8, it's still having issues.

Perhaps use something like charamel or charset-normalizer to convert the captions to utf-8 before ingest?

Serkad commented 1 month ago

same problem