graykode / nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers
https://www.reddit.com/r/MachineLearning/comments/amfinl/project_nlptutoral_repository_who_is_studying/
MIT License
14.03k stars 3.9k forks source link

the writter's Transformer torch.py 's position embed has some mistake. #39

Open zhangbo2008 opened 4 years ago

zhangbo2008 commented 4 years ago

i fixed it in the following https://github.com/zhangbo2008/nlp-tutorial/blob/master/2cpu_Input_myData.py https://github.com/zhangbo2008/nlp-tutorial/blob/master/2gpu_Input_myData.py if you find some mistake, please comment me