Dreambooth training with image captions

XavierXiao / Dreambooth-Stable-Diffusion

Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion

MIT License

7.57k stars 790 forks source link

Dreambooth training with image captions #159

Open alireza18878 opened 9 months ago

alireza18878 commented 9 months ago

Hi all,

I would like to fine-tune a Dreambooth model with my own dataset, and I want the model to learn the captions (description of pictures) as well. I tried using Datasets but it doesn't recognize the metadata.csv file. Can you please let me know if it is possible to train a Dreambooth model while incorporating the picture descriptions (captions)?

Thanks

2016312357 commented 6 months ago

You can modify Dreambooth-Stable-Diffusion-main\ldm\data\personalized.py to read your own data.