Closed wannita901 closed 2 years ago
Hi, I reproduce this error. It happens in 28532th line. It turns out that it is a corner case in the preprocessing of <STR_LIT>
. I have push a commit to fix this. You can download the newest preprocessing code, re-generate the dataset and try again. Thank your for pointing this out.
Thank you for your response! One quick question, do I need to finetune the model again? Because after I downloaded the new preprocessing code, re-generated the dataset and tried to rerun only the evaluation part, It seems like I still got the same error message?
All good, I finetune the model again and everything run smoothly. Thank you so much!
Hi! I downloaded the repo two weeks ago and ran the code completion token level. The java one is all runnable. However, the python one for fine-tuning was completed, but the evaluation found a similar error to #98.
I try deleting the line 28530th in test.txt and so on, but it's still keeping the error. My evaluation command was
Any suggestion will be very appreciated. Thanks!