Bug in epoch calculation - Githubissues

facebookresearch / CodeGen

Reference implementation of code generation projects from Facebook AI Research. General toolkit to apply machine learning to code, from dataset creation to model training and evaluation. Comes with pretrained models.

MIT License

710 stars 144 forks source link

Bug in epoch calculation #82

Open dineshkh opened 2 years ago

dineshkh commented 2 years ago

At line no. 1483 in the file codegen_sources/model/src/trainer.py. the code is self.n_sentences += params.batch_size I think it should be self.n_sentences += len1.size(0) https://github.com/facebookresearch/CodeGen/blob/6e93aca63e7bc77287c9965a5080456326651237/codegen_sources/model/src/trainer.py#L1483

With above bug notion of one epoch becomes wrong because of check at following line.

https://github.com/facebookresearch/CodeGen/blob/6e93aca63e7bc77287c9965a5080456326651237/codegen_sources/model/train.py#L742