jamespark3922 / lsmdc-fillin

Identity-Aware Multi-Sentence Video Description
https://sites.google.com/site/describingmovies/lsmdc-2019
14 stars 7 forks source link

Access Denied for Pretrained Checkpoints Link and missing Test Reference Files #3

Closed dnaveenr closed 2 years ago

dnaveenr commented 2 years ago

Hello James,

The link to download the pretrained checkpoints is not accessible. wget https://storage.googleapis.com/jamesp/lsmdc/fillin2_transformer_memory9_mtcnn_cluster_gender0.2_bert_gender_sent_emb_bs64_augmented_new_no_img.zip Access is denied for the following file.

Also, to run the evaluation on the Test Set: python eval.py --batch_size 64 --g_model_path {$exp_path}/gen_best.pth --infos_path {$exp_path}/infos.pkl --id $eval_id --split test

references_test_new.csv and testSets.csv are not present in the https://github.com/jamespark3922/lsmdc-fillin/tree/master/character_eval/input folder.

We're trying to replicate results from your paper, it would be great if you can share these files.

Thank you, Naveen

jamespark3922 commented 2 years ago

Hello,

We apologize for the confusion and thank you for pointing it out! We just fixed the storage link in README, so they should be accessible now.

wget https://storage.googleapis.com/ai2-jamesp-public/lsmdc/fillin2_transformer_memory9_mtcnn_cluster_gender0.2_bert_gender_sent_emb_bs64_augmented_new_no_img.zip

We do not release a public test set and instead you can submit your predictions via codalab to get the results. We have val results in paper so you can compare the results in val first.