issues
search
FSoft-AI4Code
/
CodeMMLU
🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.
https://fsoft-ai4code.github.io/codemmlu/
MIT License
14
stars
1
forks
source link
Dev/v0.0.1
#1
Closed
nmd2k
closed
1 month ago
nmd2k
commented
1 month ago
Version 0.0.1
What news?
Support backends: native huggingface, VLLMs
Support model's checkpoint from huggingface
Support lora model
nmd2k
commented
1 month ago
LGTM!
Version 0.0.1
What news?