Traninig Configurations

[LengSicong]

Hi, may I know what your hyper-parameter configurations are during training? Is it the default setting of those arguments?

[deepglugs]

These are the arguments I'm training with:

python3 imagen.py \
                  --source ~/nas4/datasets/holo_bikini.tar \
                  --webdataset \
                  --epochs=10 \
                  --start_epoch=1 \
                  --imagen ~/stheno/danbooru_256_new.pth \
                  --batch_size=64 --micro_batch_size=2 \
                  --samples_out danbooru_256_new \
                  --train \
                  --unet_dims=256 \
                  --unet2_dims=128 \
                  --random_drop_tags=0.5 \
                  --size=1024 \
                  --num_unets=2 \
                  --train_unet=1 \
                  --cond_scale=1.1 \
                  --self_cond \
                  --sample_steps 64 \
                  --lr 1e-4 \
                  $@