Open RizhaoCai opened 3 years ago
Hello! In the trainer.py, I have calculated the reward from validation data!
This version of the code is more difficult to understand, and finally I re-written it based on the Ray framework. But the result is still not very good.
Hello, thanks for your reproduction.
In the AM-LFS paper, the accuracy from the validation is used for loss calculation to update the parameter based on the REINFORCE rule.![image](https://user-images.githubusercontent.com/37952703/111281362-d2280380-8677-11eb-9e82-68294a852cca.png)
However, in https://github.com/GuHongyang/AM-LFS-PyTorch/blob/bb4e4f08c0c88abe7919d3ea2db46db7ef345cf9/main.py#L44, why accuracy is not returned from validation to calculate reward?