search

cshizhe / VLN-DUET

Official implementation of Think Global, Act Local: Dual-scale GraphTransformer for Vision-and-Language Navigation (CVPR'22 Oral).
113 stars 7 forks source link

Submit failed due to the navigation graph contains no edge between these viewpoints #2

Closed CrystalSixone closed 2 years ago

CrystalSixone commented 2 years ago

Hi, @cshizhe,

Thanks for your awesome work. I am trying to do some experiments based on your network and when I submitted the results (both on the validation splits and the test split) to the leaderboard, the status showed failed and the Stdout file is as follows:

In evaluation scirpt Error: The provided trajectory moves from abed00ee59594186bac2867a03ab03fd to 55c2c79e066d435bb4ca0ed7184e3b22 but the navigation graph contains no edge between these viewpoints. Please ensure the provided navigation trajectories are valid, so that trajectory length can be accurately calculated.

I used the test code in map_nav_src/scrips/run_r2r.sh and could you spend some time checking on what causes this problem?

Best wishes :)

cshizhe commented 2 years ago

Hi, I never met this problem. The format of the output predictions does not match the required submit format. Did you convert the format correctly?

CrystalSixone commented 2 years ago

Thanks for your kindly reply, but I did not change any codes about submitting format.

cshizhe commented 2 years ago

I mean the required format to submit in the leaderboard is different. You need to convert the format.

CrystalSixone commented 2 years ago

I see! I forgot to convert the format. The problem has been solved by adding the following codes in the end of function of rollout in agent.py:

   if self.args.submit:
        for i,item in enumerate(traj):
            new_paths = []
            for node in item['path']:
                for each_sub_node in node:
                    new_paths.append([each_sub_node])
            traj[i]['path'] = new_paths

Thanks again.