search

RockeyCoss / SPO

Step-aware Preference Optimization: Aligning Preference with Denoising Performance at Each Step
https://arxiv.org/abs/2406.04314
137 stars 3 forks source link

Will the evaluation benchmark be released? #9

Closed Mowenyii closed 2 months ago

RockeyCoss commented 2 months ago

The evaluation benchmark is the validation_unique split of pick-a-pic v1 dataset. You can find it here: https://huggingface.co/datasets/yuvalkirstain/pickapic_v1