search

zc-alexfan / arctic

[CVPR 2023] Official repository for downloading, processing, visualizing, and training models on the ARCTIC dataset.
https://arctic.is.tue.mpg.de
Other
314 stars 20 forks source link

Leaderboard submission #28

Closed zc-alexfan closed 1 year ago

zc-alexfan commented 1 year ago

This issue should aggregate all discussion/emails related to leaderboard submission.

zc-alexfan commented 1 year ago

Question

Hi! I have faced some problems in your ARCTIC Leaderboards page. When I tried to submit my zip file, I only can see this error message. My zip file format is exactly same yours. But I only can see below error message. Is this bug?

Here is my command line I used.

python scripts_method/extract_predicts.py --setup p2 --method arctic_lstm --load_ckpt logs/28bf3642f/checkpoints/last.ckpt --run_on test --extraction_mode submit_pose

Reply

Can you try to pull the lastest commit? There was a patch: https://github.com/zc-alexfan/arctic/pull/25

Let me know if you have any other questions,

Alex

zc-alexfan commented 1 year ago

Question

Hi,

I found that I am unable to upload my model. I've also tried using the zip file you provided directly, but unfortunately, I still can't upload it.

Do you happen to know what might be the issue?

Best Regards,

Reply

Does it work for MR-E? Or is it just MR-S that is not working?

I would suggest first downloading the zip files that we provided. Upload that to see if it works. Once it works, simply keep the file names the same while overwriting the prediction in the zip files.

Hope it helps

Alex