Open heartInsert opened 4 years ago
Hi ,everyone
.
I run the command in Readme.md. python augment.py --name cifar10 --dataset cifar10 --genotype "Genotype( normal=[[('sep_conv_3x3', 0), ('dil_conv_5x5', 1)], [('skip_connect', 0), ('dil_conv_3x3', 2)], [('sep_conv_3x3', 1), ('skip_connect', 0)], [('sep_conv_3x3', 1), ('skip_connect', 0)]], normal_concat=range(2, 6), reduce=[[('max_pool_3x3', 0), ('max_pool_3x3', 1)], [('max_pool_3x3', 0), ('skip_connect', 2)], [('skip_connect', 3), ('max_pool_3x3', 0)], [('skip_connect', 2), ('max_pool_3x3', 0)]], reduce_concat=range(2, 6))"
python augment.py --name cifar10 --dataset cifar10 --genotype "Genotype( normal=[[('sep_conv_3x3', 0), ('dil_conv_5x5', 1)], [('skip_connect', 0), ('dil_conv_3x3', 2)], [('sep_conv_3x3', 1), ('skip_connect', 0)], [('sep_conv_3x3', 1), ('skip_connect', 0)]], normal_concat=range(2, 6), reduce=[[('max_pool_3x3', 0), ('max_pool_3x3', 1)], [('max_pool_3x3', 0), ('skip_connect', 2)], [('skip_connect', 3), ('max_pool_3x3', 0)], [('skip_connect', 2), ('max_pool_3x3', 0)]], reduce_concat=range(2, 6))"
My enviroment is pytorch 1.2 and device is a single RTX2080Ti , but 600 epoch seems will cost at about 20 hours , it's a little longer to me , is there any method that we can accelerate convergence , such as change the SGD optimizer to Adam ?
600 epoch
20 hours
Hi ,everyone
I run the command in Readme.md.
python augment.py --name cifar10 --dataset cifar10 --genotype "Genotype( normal=[[('sep_conv_3x3', 0), ('dil_conv_5x5', 1)], [('skip_connect', 0), ('dil_conv_3x3', 2)], [('sep_conv_3x3', 1), ('skip_connect', 0)], [('sep_conv_3x3', 1), ('skip_connect', 0)]], normal_concat=range(2, 6), reduce=[[('max_pool_3x3', 0), ('max_pool_3x3', 1)], [('max_pool_3x3', 0), ('skip_connect', 2)], [('skip_connect', 3), ('max_pool_3x3', 0)], [('skip_connect', 2), ('max_pool_3x3', 0)]], reduce_concat=range(2, 6))"My enviroment is pytorch 1.2 and device is a single RTX2080Ti , but
600 epochseems will cost at about20 hours, it's a little longer to me , is there any method that we can accelerate convergence , such as change the SGD optimizer to Adam ?