search

YicongHong / Recurrent-VLN-BERT

Code of the CVPR 2021 Oral paper: A Recurrent Vision-and-Language BERT for Navigation
Other
150 stars 29 forks source link

How to get "R2R Test Uneen" results in table 1? #27

Open dongxinfeng1 opened 1 week ago

dongxinfeng1 commented 1 week ago

Based on the checkpoints you provide, we can reproduce the "R2R Validation Seen" and "R2R Validation Uneen" results in table 1. But how to get "R2R Test Uneen" results? Could you give me some advice?

YicongHong commented 1 week ago

Hi! You need to use the test mode to evaluate with the R2R_test.json instructions and submit the output .json results file to the EvalAI leaderboard.

dongxinfeng1 commented 1 week ago

Thanks so much for your response! I try to upload "submit_test.json" to this board, but I cannot find the entrance to the results. Is this the entrance to get results? 

2183570768 @.***

 

------------------ 原始邮件 ------------------ 发件人: "YicongHong/Recurrent-VLN-BERT" @.>; 发送时间: 2024年10月24日(星期四) 晚上6:47 @.>; @.**@.>; 主题: Re: [YicongHong/Recurrent-VLN-BERT] How to get "R2R Test Uneen" results in table 1? (Issue #27)

Hi! You need to use the test mode to evaluate with the R2R_test.json instructions and submit the output .json results file to the EvalAI leaderboard.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>