Convert the semantic annotations to habitat format

[rginpan]

ACTIVE_DATASET="gibson" python scripts/create_semantic_maps.py Number of available scenes: 0 ===========> Extracting scene boundaries 0it [00:00, ?it/s] ===========> Extracting point-clouds 0it [00:00, ?it/s] ===========> Extracting semantic maps 0it [00:00, ?it/s]

After I have generated the semantic annotations for Gibson from 3DSceneGraph dataset, I obtained the .ids and .scn files for each scene, and I put all of them in /gibson_semantic folder, then I would like to use create_semantic_maps.py to convert them to habitat format, but I got the aboved msgs. Could you plz take a look? Thanks!

[rginpan]

Update: I obtain the .ids .scn ._semantic.ply, and put them in one folder of all scenes, but still got the above msgs when I run that script, could you plz show the structure of files inside of /gibson_semantic folder?

[rginpan]

Could you show the dataset folder structure? What are the files inside of gibson_semantic folder, for me, I have scene_name.glb scene_name.navmesh scene_name.ids scene_name.scn scene_name_semantic.ply, in total 5 files, is it correct? do I need .obj file?

[srama2512]

@rginjapan Here is my dataset structure.

➜  gibson_semantic ls | head -n 10
Adairsville.glb
Adairsville.ids
Adairsville.navmesh
Adairsville.scn
Adairsville_semantic.ply
Airport.glb
Airport.ids
Airport.navmesh
Airport.scn
Airport_semantic.ply

[qymao]

I had the same problem, even follow your data structure. Could you please show us the detailed split of Gibson you used?

Number of available scenes: 0 ===========> Extracting scene boundaries 0it [00:00, ?it/s] ===========> Extracting point-clouds 0it [00:00, ?it/s] ===========> Extracting semantic maps 0it [00:00, ?it/s]

[rginpan]

Thanks for your reply, I have some scenes which do not contain all 5 formats such as Ackermanville only has two formats. Does it affect the results?

[srama2512]

@rginjapan - yes, that will affect the results. The semantic files are necessary to generate the objects in the semantic map. Can you please check the semantic maps for scenes with semantic files? They should contain the objects.

[Robot-zeg]

Could you show the dataset folder structure? What are the files inside of gibson_semantic folder, for me, I have scene_name.glb scene_name.navmesh scene_name.ids scene_name.scn scene_name_semantic.ply, in total 5 files, is it correct? do I need .obj file?

@rginjapan I see you only have .ids .scn . _semantic .ply before. Could you tell me how to get .glb and .navmesh?

[rginpan]

@Yuanze-wang I did not remember... I think they are downloaded from somewhere...

[NormanMises]

I had the same problem, even follow your data structure. Could you please show us the detailed split of Gibson you used?

Number of available scenes: 0 ===========> Extracting scene boundaries 0it [00:00, ?it/s] ===========> Extracting point-clouds 0it [00:00, ?it/s] ===========> Extracting semantic maps 0it [00:00, ?it/s]

I have the same data structure, but still get this result. I remember habitat-sim says

To use semantics, you will need to enable the semantic sensor.

Once you have downloaded the Gibson dataset and converted the semantic data, you should download this SceneDatasetConfig file and place it in the root directory for the Gibson dataset (e.g. Habitat-Sim/data/scene_datasets/gibson/). This file should then be specified as the scene dataset config in the SimulatorConfiguration structure like this example for the ReplicaCAD dataset.

But I don't quite understand how to do it specifically, so I skipped this step. Does this affect the result of the semantic annotation conversion? If so, please tell me how to do it, thank you!