-
## Paste the link of the GitHub organisation below and submit
https://github.com/google-research
---
###### Please subscribe to this thread to get notified when a new repository is created
-
I want to evaluate llama-3.1-instruct on the Math benchmark. The code runs without any error but it seems that the score each 0, which doesn't match what is on HF. Any help?
```sh
!lm_eval \
…
-
https://github.com/hendrycks/test/pull/13
https://github.com/EleutherAI/lm-evaluation-harness/pull/497
Want to add Falcon 40B here:
 I got some results with medium.yaml, but I w…
-
模型：https://modelscope.cn/models/OpenBMB/MiniCPM-V-2_6
通常，多模态大模型微调会使用自定义数据集进行微调。在这里，我们将展示可直接运行的demo。
在开始微调之前，请确保您的环境已准备妥当。
```bash
git clone https://github.com/modelscope/swift.git
cd swift
…