search

salesforce / CodeTF

CodeTF: One-stop Transformer Library for State-of-the-art Code LLM
Apache License 2.0
1.46k stars 101 forks source link

Examples for evaluation metrics #36

Open Paul-B98 opened 1 year ago

Paul-B98 commented 1 year ago

https://github.com/salesforce/CodeTF/blob/main/codetf/performance/evaluation_metric.py

would it be possible to extend the existing example of training and inference with the evaluation. If u give me a short example or explanation, I could make a pr for it.