search

shailja-thakur / VGen

Apache License 2.0
114 stars 8 forks source link

Evaluation data release #2

Open TimrayZ opened 1 year ago

TimrayZ commented 1 year ago

Hi, I'm wonrdering if it is possible for you to release evaluation dataset? I'm also working on this problem and I find your benchmark really useful. It would be helpful for me to try your benchmark on some new models.

99EnriqueD commented 1 year ago

I second this, access to the evaluation dataset would be awesome!

foundten commented 1 year ago

https://github.com/shailja-thakur/VGen/commit/8737edac797d44d59453e8368734cdcbb2447434

This was added 15 hours ago. Is this what you were requesting?

lee-man commented 1 year ago

Look forward to accessing the training set.

99EnriqueD commented 1 year ago

8737eda

This was added 15 hours ago. Is this what you were requesting?

Yes indeed, thanks!