search

jialuli-luka / PanoGen

Code and Data for Paper: PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation
73 stars 5 forks source link

How to generate panoramic caption #2

Closed lizixiaoboluo closed 1 year ago

lizixiaoboluo commented 1 year ago

Why is my Matterport3D data different from yours？ I noticed that views_img has a different directory structure, e.g., 'views_img/r1Q1Z4BcV1o/a72aa7b4304f4c318af76653d9950c80/5.jpg', which is different from the original directory structure in matterport3d.Such as the original directory structure in matterport3d is '0b22fa63d0f54a529c525afbf2e8bb25_skybox0_sami.jpg'. Why is my Matterport3D data diffenent? Thank you for your patience.

jialuli-luka commented 1 year ago

You could get the discretized RGB images from the matterport3D simulator.

lizixiaoboluo commented 1 year ago

How to save the discretized RGB images from the matterport3D simulator to my computer？Thank you for your patience again！

jialuli-luka commented 1 year ago

You could refer to the image feature extraction code here for how to use the simulator and get the RGB information: https://github.com/cshizhe/VLN-HAMT/blob/main/preprocess/precompute_img_features_vit.py

lizixiaoboluo commented 1 year ago

Think you very much!