search

rese1f / MovieChat

[CVPR 2024] 🎬💭 chat with over 10K frames of video!
https://rese1f.github.io/MovieChat/
BSD 3-Clause "New" or "Revised" License
454 stars 37 forks source link

Inquery about the release of the validation set #66

Closed patrick-tssn closed 4 weeks ago

patrick-tssn commented 4 weeks ago

Thank you for your work, when will you release the validation set?

Espere-1119-Song commented 4 weeks ago

the videos of the validation set have been released, and the json files will be released after our CVPR2024 LOVEU workshop challenge (about 1-2 weeks).

patrick-tssn commented 4 weeks ago

Thank you for your quick reply, the evaluation pipeline for the workshop seems broken.

python: can't open file '/tmp/codalab/tmpKqYi3w/run/$scoring_program/evaluate.py': [Errno 2] No such file or directory

Espere-1119-Song commented 4 weeks ago

please ignore it. once you submit your results, we will receive and evaluate

patrick-tssn commented 4 weeks ago

How can I get the result? Will this submission (status: failed) be considered a valid attempt and count towards the quota?

Espere-1119-Song commented 4 weeks ago

we will email you.

the failed submission will be considered a valid attempt and count towards the quota too.

patrick-tssn commented 4 weeks ago

Thank you for your reply.