search

facebookresearch / flores

Facebook Low Resource (FLoRes) MT Benchmark
Other
705 stars 123 forks source link

Submission to DynaBench does not show results #28

Closed dannigt closed 3 years ago

dannigt commented 3 years ago

Hi, I have a question regarding submitting models to DynaBench.

We followed the instructions in /dynalab/ and submitted a model around 24 hours ago. As the first test, we just submitted the pretrained small model.

The status has been green with label "created". However we are not able to see the results. There is a note in the bottom of the page showing "No data available, the model is still evaluating."

Therefore I'm wondering how long it typically takes to see the evaluation results. If ~24 hours is not a normal timespan, could you suggest some directions for troubleshooting on our side?

Thanks in advance for your help! Danni

dannigt commented 3 years ago

It works after following the suggestions here: https://github.com/facebookresearch/dynalab/issues/93