Closed Marigod98 closed 1 year ago
maybe this part should be train_step < 50000? not should be epoch<50000 for epoch in range(1, params.epochs + 1):
if train_step < 10000: alpha = 0.01 elif train_step < 20000: alpha = 0.1 elif epoch < 50000: alpha = 0.5 else: alpha = 1.0
Yes, you are right! I have rectified the code.
maybe this part should be train_step < 50000? not should be epoch<50000 for epoch in range(1, params.epochs + 1):
hyperparameter alpha