how to pre train my own unixcoder from the pre-train unixcoder

microsoft / CodeBERT

CodeBERT

MIT License

2.09k stars 430 forks source link

how to pre train my own unixcoder from the pre-train unixcoder #324

Open LO-FANG opened 1 month ago

LO-FANG commented 1 month ago

Thanks for your amazing works ! How to pre train my own unixcoder base on your unixcoder? Do I need to reproduce tasks such as MLM or something? I want unixcoder to support additional programming languages. But I am starter in this domain, I do want to know how can I reproduce your works.