search

GaParmar / img2img-turbo

One-step image-to-image with Stable Diffusion turbo: sketch2image, day2night, and more
MIT License
1.33k stars 145 forks source link

Training Details of Cyclegan_turbo from Night to Day？ #46

Open weihongwei-zg opened 1 month ago

weihongwei-zg commented 1 month ago

Hello author, I noticed that the night to day effect in this project is very stunning. I would like to reproduce this work and use it in my own data scenario. But the document only includes the conversion of zebras and does not include the details of day and night conversion. Can you provide the amount of data for day and night conversion, as well as the training configuration?

GaParmar commented 1 month ago

We use the BDD100k driving dataset for the day to night conversion model. For dataset processing, we resize all images to 512x512 during training and inference. The other configurations should be the same!

weihongwei-zg commented 1 month ago

Hello, my training set consists of 6000 paired images that generate visible light from infrared. The training environment is a 4090 graphics card, The batch_size is set to 1, with a size of 256x256. After 3 iterations, the effect is poor and not as good as the original cyclegan algorithm. Could you please help to point out the reason for this? 1 2

weihongwei-zg commented 1 month ago

It seems that the brightness and darkness are opposite.

kaka45inablink commented 4 weeks ago

@GaParmar Hi dear author, May I ask how to set the prompt for the day to night conversion model when training? "driving in the night" for a2b and "driving in the day" for b2a?