search

LAION-AI / Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
https://open-assistant.io
Apache License 2.0
36.85k stars 3.22k forks source link

KeyError when running command for training reward model #3687

Open bhauptvogel opened 10 months ago

bhauptvogel commented 10 months ago

The README.md files in the model and the model/model_training folder include the following command python trainer_rm.py --configs defaults_rm oasst-rm-1-pythia-1b to train the reward model. Running this command returns a KeyError: 'oasst-rm-1-pythia-1b' since the model/model_training/configs/config_rm.yaml file only has the following model options