IrisRainbowNeko / DreamArtist-stable-diffusion

stable diffusion webui with contrastive prompt tuning
873 stars 53 forks source link

Not getting desired result, loss shrinking during ~400 steps #14

Closed Raz0rStorm closed 2 years ago

Raz0rStorm commented 2 years ago

Tried many times training, but still no good result Like in the first ~400steps it seems like it's going somewhere with a loss ~0.3 but after that, the loss suddenly shrink to ~0.05 and become stagnated also I don't know how to use both the convnext model? tried lr from 0.01-0.0025 cfg 3-5 without success Is there something I've done wrong? Using Anything-V3.0-pruned.ckpt, setting: { "bs": 1, "cfg": 3.0, "lr": "0.0025", "neg": true, "neg_lr_w": 1, "prompt_len": [ 6, 768 ], "prompt_len_neg": [ 12, 768 ], "rec": true, "rec_loss_w": 1, "size": 384 } Input image: 00012-0-eaf9d358dd2525db5d59fdc28a0f6757 Output after 5000 steps: 00001-993531467 prompt_tuning_loss.csv

IrisRainbowNeko commented 2 years ago

The original instructions are quite rough and you may not use DreamArtist correctly. You can use it following the new instructions.

Raz0rStorm commented 2 years ago

The original instructions are quite rough and you may not use DreamArtist correctly. You can use it following the new instructions. 草,原来大佬是国人 我再看了一下,我做的时候没设置txt2img,但是这个应该只影响预览图像吧 还有在训练栏目里我这没显示DreamArtist Train而是Train,不知道有没有问题 图片 还有新教程里没写convnext相关的信息,是应该不用它们吗?如果要用的话怎么同时用checkpoint-best_t5.pth和convnext_xlarge_22k_1k_384_ema.pth呢? 谢谢大佬了!

IrisRainbowNeko commented 2 years ago

还有新教程里没写convnext相关的信息

convnext可以参考我另外的AI爬虫,按这个方式练的就可以用,你喜欢的放类别1