some question about the size of code base

microsoft / CodeBERT

CodeBERT

MIT License

2.15k stars 442 forks source link

some question about the size of code base #235

Open wusuhuang opened 1 year ago

wusuhuang commented 1 year ago

Hello, You work are so amazing. I just want to know the metric of MRR. In each experiment, the size of codebase can affect the result. I find in CodeBert and GraphCodeBert, the size of codebase is different. And can they be compared?

thank you very much if you can reply my question!!

guoday commented 1 year ago

If you perform the same dataset, the result is comparable. Otherwise, it's not.