search

microsoft / CodeBERT

CodeBERT
MIT License
2.15k stars 442 forks source link

About CodeReviewer, how can i get the two files, 'cls_head.bias' and 'cls_head.weight' #257

Open Qinhaifu opened 1 year ago

Qinhaifu commented 1 year ago

I have finished finetune, but i can not find these two files. when i try to run test_model.py. it is error error log: Some weights of ReviewerModel were not initialized from the model checkpoint at microsoft/codereviewer and are newly initialized: ['cls_head.bias', 'cls_head.weight'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

celbree commented 1 year ago

If you didn't finetune in the quality estimation task, then ignore it because it doesn't need a cls_head.

Qinhaifu commented 1 year ago

If you didn't finetune in the quality estimation task, then ignore it because it doesn't need a cls_head.

I run finetune-cls.sh with these data "Our dataset is available in Zenodo.". i think it will finetune in the quality estimation task. Is there no cls_head.bias because i did not use other data that different from official data? And i run test_model.py, it's answer looks too simple, do i have to finetune it for better answer?