search

PrefLib / PrefLib-Contrib

Repository to keep track of contributions and TODO's for the www.PrefLib.org website.
GNU General Public License v3.0
1 stars 0 forks source link

Hugging Face? #15

Open nmattei opened 1 year ago

nmattei commented 1 year ago

Q/A Response dataset? https://huggingface.co/datasets/stanfordnlp/SHP

Simon-Rey commented 1 year ago

What's your idea here? Like how do you convert it into PrefLib?

Simon-Rey commented 1 year ago

Similar idea: https://huggingface.co/datasets/Anthropic/hh-rlhf and https://huggingface.co/datasets/OpenAssistant/oasst1

For Anthropic it does not seem to be good since each answer is presented only once, so we would just have highly incomplete data.

For Oasst I'm still trying to understand the file...

Simon-Rey commented 1 year ago

Same for OASST actually, each message seems unique.