search

Ram81 / goat-bench

60 stars 8 forks source link

About Table 5 in the Appendix. #7

Closed kellyiss closed 5 months ago

kellyiss commented 7 months ago

Hi, thanks for the wonderful work!

I have a question about the Performance of individual skills used for RL Skill Chain baseline which is shown in Table5 in the Appendix. Is VAL UNSEEN EASY referring to Val Seen Synonyms Split or a subset of the Val Unseen Split?

Looking forward to your reply!

Ram81 commented 5 months ago

Hi @kellyiss , sorry for confusion. The val unseen easy refers to val seen synonym split. Thanks for pointing this out, we will fix it on arxiv!