search

for-ai / m-rewardbench

Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings
https://m-rewardbench.github.io/
MIT License
16 stars 2 forks source link

Add RewardBench script #6

Closed ljvmiranda921 closed 4 months ago

ljvmiranda921 commented 4 months ago

You can reuse the configs here: https://github.com/allenai/reward-bench/blob/main/scripts/configs/eval_configs.yaml c.f. #4

sanggusti commented 4 months ago

Can you show us what is the output of scripts/convert_multilingual_uf.py before merging?

sanggusti commented 4 months ago

Can you show us what is the output of scripts/convert_multilingual_uf.py before merging?

Oh I've just see it in Discord. Thanks LJ! image