gwang-kim / DiffusionCLIP

[CVPR 2022] Official PyTorch Implementation for DiffusionCLIP: Text-guided Image Manipulation Using Diffusion Models
Other
785 stars 113 forks source link

Finetuning bedroom models #17

Open GaParmar opened 2 years ago

GaParmar commented 2 years ago

Hi,

This work is amazing! I am trying to reproduce the bedroom editing results you have shown in the paper. I can achieve them when I use the pretrained finetuned model provided in google drive. However when I try to finetune the model myself, I get very poor results. This is the command I used for finetuning the model. Could you tell me if some of the hyperparemeters are set incorrectly here?

python main.py --clip_finetune \
            --config bedroom.yml      \
            --exp ./test_runs/bedrooms_full        \
            --edit_attr "bedroom_princess"  \
            --do_train 1             \
            --do_test 1              \
            --n_train_img 50         \
            --n_test_img 10          \
            --n_iter 5               \
            --t_0 500                \
            --n_inv_step 40          \
            --n_train_step 6         \
            --n_test_step 40         \
            --lr_clip_finetune 8e-6  \
            --id_loss_w 0            \
            --l1_loss_w 1

-Gaurav

wzr1201 commented 6 months ago

have you get good results finally