MarSaKi / VLN-BEVBert

[ICCV 2023} Official repo of "BEVBert: Multimodal Map Pre-training for Language-guided Navigation"
184 stars 5 forks source link

Lack “R2R_VLNCE_v1-2_preprocessed” directory for VLN-CE evaluation. #17

Open lu-renjie opened 5 months ago

lu-renjie commented 5 months ago

I was able to run the code on VLN-CE training. But I encountered an issue during VLN-CE evaluation. It appears that the 'R2R_VLNCE_v1-2_preprocessed' directory is missing. The data provided by ETPNav only includes 'R2R_VLNCE_v1-2_preprocessed_BERTidx'.

MarSaKi commented 5 months ago

Sorry for the typo, you can change the filename to 'R2R_VLNCE_v1-2_preprocessed' and try again.

lu-renjie commented 5 months ago

It seems that it is not a typo. The files in the 'R2R_VLNCE_v1-2_preprocessed_BERTidx' directory follow the format '{split}/{split}_bertidx.json.gz', whereas in the 'R2R_VLNCE_v1-2_preprocessed' directory, the files follow the format '{split}/{split}_gt.json.gz'.

Additionally, based on the code, the data in '{split}/{split}_gt.json.gz' is used by self.gt_data[ep_id]['locations']. However, the data in '{split}/{split}_bertidx.json.gz' appears as follows:

{
 ''episodes': {'episode_id': 1,
   'trajectory_id': 15,
   'scene_id': 'mp3d/zsNo4HB9uLZ/zsNo4HB9uLZ.glb',
   'start_position': [15.068599700927734, 0.17162801325321198, -4.4848198890686035],
   'start_rotation': [0, 0.6198966754439885, 0, -0.7846834468583432],
   'info': {'geodesic_distance': 7.9608235359191895},
   'goals': [{'position': [...], 'radius': 3.0}],
   'instruction': {'instruction_text': ..., 'instruction_tokens': [...]},
   'reference_path': [...]
  },
 'instruction_vocab': {...}
}

As you can see, there is no 'locations' field in it."

MarSaKi commented 5 months ago

Hi, you can try this one "https://drive.google.com/file/d/1FJ2xs1Q0lSI-bN1Gi8BElN8xbEft8aum/view?usp=sharing". I just upload it.

lu-renjie commented 5 months ago

It works! Thank you very much!