allenai / reward-bench

RewardBench: the first evaluation tool for reward models.
https://huggingface.co/spaces/allenai/reward-bench
Apache License 2.0
440 stars 52 forks source link

Add Nvidia RMs (and Nemo compatibility) #76

Closed natolambert closed 4 months ago

natolambert commented 8 months ago

See below! https://huggingface.co/models?library=nemo&search=RM

This involves converting to HF format or adding nemo compatibility, if anyone has time!

natolambert commented 4 months ago

Closing because stale.

Riashat commented 12 hours ago

Hello @natolambert

Is there any update on this? Or do you know if anyone has used Nvidia nemo RMs in Reward-Bench or M-Reward-Bench for compatibility?