amazon-science / CodeSage

CodeSage: Code Representation Learning At Scale (ICLR 2024)
https://code-representation-learning.github.io
Apache License 2.0
75 stars 3 forks source link

Baselines for CodeSage #13

Open Pengwei-Jin opened 1 month ago

Pengwei-Jin commented 1 month ago

Would it be possible to release the evaluation scripts of baselines for CodeSage including CodeBert, Starencoder and so on? It seems that the evaluation script for CodeSage cannot be directly used to evaluate baseline models.

wasiahmad commented 1 month ago

For the baseline models, you can take a look at the CodeBERT repository which is the basis of our code for finetuning CodeSage and evaluation. We do not plan to release evaluation scripts for the baselines.

cc: @Dejiao2018