search

kohya-ss / sd-scripts

Apache License 2.0
5.25k stars 871 forks source link

using '--alpha_mask' option seems not training text encoder #1657

Open BbChip0103 opened 1 month ago

BbChip0103 commented 1 month ago

Hi. I usually use '--alpha_mask' option in the 'dev' branch. If i use this option, text_encoder learning curve is disappear in the tensorboard. image

without '--alpha_mask' option, text_encoder training seems to work well. image

Am i something wrong?

BbChip0103 commented 1 month ago

I found something more. regardless --alpha_mask option, text_encoder was not loaded (related on transformers module) I solve this issue using transformers==4.42.4

transformers>=4.43.0 image

transformers<=4.42.4 image

sadly, text_encoder loss curve is still not shown in the tensorboard. but as i checked the size of trained checkpoint, text_encoder may be contained.