Closed MXueguang closed 3 years ago
Thanks for catching these! Will push a fix asap.
I am super surprised that the second typo happened during the refactor. It actually got me worried and I went back to check all of my other repos that have the same function call. Fortunately they all seem correct.. I guess it is just a bad idea to multi-task on too many things at the same time..
closing the issue, since (2) get fixed
Hi @luyug, Great work!!!!
I am trying to replicate COIL, there is some typo I noticed.
in README.md Encoding section
should be 32, 768 instead?
https://github.com/luyug/COIL/blob/813a076ad7526536dad5d4fc71eee5f7f8113700/trainer.py#L42
num_training_steps
should be passed into the function rather thanwarmup_steps
?