search

yuvalkirstain / PickScore

MIT License
373 stars 20 forks source link

about unique dataset #5

Closed huxian0402 closed 8 months ago

huxian0402 commented 1 year ago

Hi, I am interested in your work. The dataset is divided into the following parts: "train," "validation," "test," "validation_unique," and "test_unique." What is the difference between "validation" and "validation_unique"? and What is the difference between "test" and "test_unique"? @infoseceskimo @shahbuland @yuvalkirstain

yuvalkirstain commented 1 year ago

Hi! the different between validation and validation_unique is that validation_unique has only one example for each prompt (same for test).

yuvalkirstain commented 1 year ago

@huxian0402 if this answers your question please close the issue :)