facebookresearch / habitat-sim

A flexible, high-performance 3D simulator for Embodied AI research.
https://aihabitat.org/
MIT License
2.67k stars 427 forks source link

Example in examples/tutorials/nb_python/ReplicaCAD_quickstart.py Not Working ! #2026

Closed ykaganov closed 1 year ago

ykaganov commented 1 year ago

Hi,

I installed Habtit-sim 0.2.2 with conda:

conda list: habitat-sim 0.2.2 pypi_0 pypi habitat-sim-mutex 1.0 headless_nobullet aihabitat

I also downloaded the replica-cad dataset by running: python -m habitat_sim.utils.datasets_download --uids replica_cad_dataset replica_cad_baked_lighting --data-path /path/to/data/ python -m habitat_sim.utils.datasets_download --uids replica_cad_dataset replica_cad --data-path /path/to/data/

When running the examples/tutorials/nb_python/ReplicaCAD_quickstart.py I get the following error: "Navmesh file not found, checked at filename : ''" ", - I therefore cannot load the navmesh. The navmeshes are definitely in the dataset and the replicaCAD.scene_dataset_config.json has a "navmesh" field pointing to the correct location of navmeshes. Still it cannot find them.

Here is the full output:

[17:56:14:838524]:[Metadata] AttributesManagerBase.h(380)::createFromJsonOrDefaultInternal : : Proposing JSON name : default.scene_dataset_config.json from original name : default| This file does not exist. [17:56:14:838681]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (capsule3DSolid:capsule3DSolid_hemiRings_4_cylRings_1_segments_12_halfLen_0.75_useTexCoords_false_useTangents_false) created and registered. [17:56:14:838729]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (capsule3DWireframe:capsule3DWireframe_hemiRings_8_cylRings_1_segments_16_halfLen_1) created and registered. [17:56:14:838761]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (coneSolid:coneSolid_segments_12_halfLen_1.25_rings_1_useTexCoords_false_useTangents_false_capEnd_true) created and registered. [17:56:14:838793]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (coneWireframe:coneWireframe_segments_32_halfLen_1.25) created and registered. [17:56:14:838815]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (cubeSolid:cubeSolid) created and registered. [17:56:14:838839]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (cubeWireframe:cubeWireframe) created and registered. [17:56:14:838865]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (cylinderSolid:cylinderSolid_rings_1_segments_12_halfLen_1_useTexCoords_false_useTangents_false_capEnds_true) created and registered. [17:56:14:838890]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (cylinderWireframe:cylinderWireframe_rings_1_segments_32_halfLen_1) created and registered. [17:56:14:838918]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (icosphereSolid:icosphereSolid_subdivs_1) created and registered. [17:56:14:838943]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (icosphereWireframe:icosphereWireframe_subdivs_1) created and registered. [17:56:14:838970]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (uvSphereSolid:uvSphereSolid_rings_8_segments_16_useTexCoords_false_useTangents_false) created and registered. [17:56:14:838991]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (uvSphereWireframe:uvSphereWireframe_rings_16_segments_32) created and registered. [17:56:14:839006]:[Metadata] AssetAttributesManager.cpp(110)::AssetAttributesManager : Built default primitive asset templates : 12 [17:56:14:839377]:[Metadata] SceneDatasetAttributesManager.cpp(35)::createObject : File (default) not found, so new default dataset attributes created and registered. [17:56:14:839388]:[Metadata] MetadataMediator.cpp(120)::createSceneDataset : Dataset default successfully created. [17:56:14:839401]:[Metadata] AttributesManagerBase.h(380)::createFromJsonOrDefaultInternal : : Proposing JSON name : ./data/default.physics_config.json from original name : ./data/default.physics_config.json| This file does not exist. [17:56:14:839420]:[Metadata] PhysicsAttributesManager.cpp(26)::createObject : File (./data/default.physics_config.json) not found, so new default physics manager attributes created and registered. [17:56:14:839428]:[Metadata] MetadataMediator.cpp(210)::setActiveSceneDatasetName : Attempting to create new dataset data/replica_cad/replicaCAD.scene_dataset_config.json [17:56:14:839435]:[Metadata] AttributesManagerBase.h(380)::createFromJsonOrDefaultInternal : : Proposing JSON name : data/replica_cad/replicaCAD.scene_dataset_config.json from original name : data/replica_cad/replicaCAD.scene_dataset_config.json| This file does not exist. [17:56:14:839462]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (capsule3DSolid:capsule3DSolid_hemiRings_4_cylRings_1_segments_12_halfLen_0.75_useTexCoords_false_useTangents_false) created and registered. [17:56:14:839484]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (capsule3DWireframe:capsule3DWireframe_hemiRings_8_cylRings_1_segments_16_halfLen_1) created and registered. [17:56:14:839505]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (coneSolid:coneSolid_segments_12_halfLen_1.25_rings_1_useTexCoords_false_useTangents_false_capEnd_true) created and registered. [17:56:14:839523]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (coneWireframe:coneWireframe_segments_32_halfLen_1.25) created and registered. [17:56:14:839541]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (cubeSolid:cubeSolid) created and registered. [17:56:14:839557]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (cubeWireframe:cubeWireframe) created and registered. [17:56:14:839578]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (cylinderSolid:cylinderSolid_rings_1_segments_12_halfLen_1_useTexCoords_false_useTangents_false_capEnds_true) created and registered. [17:56:14:839597]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (cylinderWireframe:cylinderWireframe_rings_1_segments_32_halfLen_1) created and registered. [17:56:14:839615]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (icosphereSolid:icosphereSolid_subdivs_1) created and registered. [17:56:14:839633]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (icosphereWireframe:icosphereWireframe_subdivs_1) created and registered. [17:56:14:839652]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (uvSphereSolid:uvSphereSolid_rings_8_segments_16_useTexCoords_false_useTangents_false) created and registered. [17:56:14:839670]:[Metadata] AssetAttributesManager.cpp(121)::createObject : Asset attributes (uvSphereWireframe:uvSphereWireframe_rings_16_segments_32) created and registered. [17:56:14:839682]:[Metadata] AssetAttributesManager.cpp(110)::AssetAttributesManager : Built default primitive asset templates : 12 [17:56:14:839902]:[Metadata] SceneDatasetAttributesManager.cpp(35)::createObject : File (data/replica_cad/replicaCAD.scene_dataset_config.json) not found, so new default dataset attributes created and registered. [17:56:14:839913]:[Metadata] MetadataMediator.cpp(120)::createSceneDataset : Dataset data/replica_cad/replicaCAD.scene_dataset_config.json successfully created. [17:56:14:839920]:[Metadata] MetadataMediator.cpp(217)::setActiveSceneDatasetName : Attempt to create new dataset data/replica_cad/replicaCAD.scene_dataset_config.json succeeded. Currently active dataset : data/replica_cad/replicaCAD.scene_dataset_config.json [17:56:14:839929]:[Metadata] MetadataMediator.cpp(175)::setCurrPhysicsAttributesHandle : Old physics manager attributes changed to ./data/default.physics_config.json successfully. [17:56:14:839938]:[Metadata] MetadataMediator.cpp(66)::setSimulatorConfiguration : Set new simulator config for scene/stage : NONE and dataset : data/replica_cad/replicaCAD.scene_dataset_config.json which is currently active dataset. Renderer: NVIDIA A100-SXM4-40GB/PCIe/SSE2 by NVIDIA Corporation OpenGL version: 4.6.0 NVIDIA 470.141.03 Using optional features: GL_ARB_vertex_array_object GL_ARB_ES2_compatibility GL_ARB_separate_shader_objects GL_ARB_robustness GL_ARB_texture_storage GL_ARB_invalidate_subdata GL_ARB_texture_storage_multisample GL_ARB_multi_bind GL_ARB_direct_state_access GL_ARB_get_texture_sub_image GL_ARB_texture_filter_anisotropic GL_KHR_debug Using driver workarounds: no-forward-compatible-core-context nv-egl-incorrect-gl11-function-pointers no-layout-qualifiers-on-old-glsl nv-zero-context-profile-mask nv-implementation-color-read-format-dsa-broken nv-cubemap-inconsistent-compressed-image-size nv-cubemap-broken-full-compressed-image-query nv-compressed-block-size-in-bits [17:56:15:084668]:[Metadata] MetadataMediator.cpp(279)::getSceneInstanceAttributesByName : No existing scene instance attributes containing name NONE found in Dataset : data/replica_cad/replicaCAD.scene_dataset_config.json but 1 StageAttributes found. Using NONE as stage and to construct a SceneInstanceAttributes with same name that will be added to Dataset. [17:56:15:084812]:[Metadata] SceneDatasetAttributes.cpp(47)::addNewSceneInstanceToDataset : Dataset : 'replicaCAD' : Stage Attributes 'NONE' specified in Scene Attributes exists in dataset library. [17:56:15:084821]:[Metadata] SceneDatasetAttributes.cpp(84)::addNewSceneInstanceToDataset : Dataset : 'replicaCAD' : Lighting Layout Attributes 'no_lights' specified in Scene Attributes but does not exist in dataset, so creating. [17:56:15:084835]:[Metadata] AttributesManagerBase.h(380)::createFromJsonOrDefaultInternal : : Proposing JSON name : no_lights.lighting_config.json from original name : no_lights| This file does not exist. [17:56:15:084853]:[Metadata] LightLayoutAttributesManager.cpp(36)::createObject : File (no_lights) not found, so new default light layout attributes created and registered. [17:56:15:084865]:[Sim] Simulator.cpp(237)::createSceneInstance : Navmesh file location in scene instance : [17:56:15:084879]:[Sim] Simulator.cpp(246)::createSceneInstance : Navmesh file not found, checked at filename : '' [17:56:15:084905]:[Scene] SceneGraph.h(85)::createDrawableGroup : Created DrawableGroup: [17:56:15:084921]:[Assets] ResourceManager.cpp(194)::initPhysicsManager : :

Physics was enabled and Bullet physics engine was specified, but the project is built without Bullet support. Objects added to the scene will be restricted to kinematic updates only. Reinstall with --bullet to enable Bullet dynamics.

[17:56:15:084945]:[Assets] ResourceManager.cpp(1652)::ConfigureImporterManagerGLExtensions : Importing Basis files as BC7. [17:56:15:085199]:[Sim] Simulator.cpp(302)::createSceneInstance : Using scene instance-specified Light key : - no_lights - [17:56:15:085216]:[Metadata] MetadataMediator.cpp(66)::setSimulatorConfiguration : Set new simulator config for scene/stage : NONE and dataset : data/replica_cad/replicaCAD.scene_dataset_config.json which is currently active dataset. [17:56:15:085236]:[Sim] Simulator.cpp(412)::instanceStageForSceneAttributes : Start to load stage named : NONE with render asset : NONE and collision asset : NONE [17:56:15:085285]:[Assets] ResourceManager.cpp(691)::createStageAssetInfosFromAttributes : Frame :{"up":[0,1,0],"front":[0,0,-1],"origin":[0,0,0]} for render mesh named : NONE|{"up":[0,1,0],"front":[0,0,-1],"origin":[0,0,0]} for semantic mesh named : with type specified as semantic|Semantic Txtrs : False [17:56:15:085296]:[Assets] ResourceManager.cpp(507)::loadStage : Start load render asset NONE . [17:56:15:085303]:[Assets] ResourceManager.cpp(973)::loadStageInternal : Attempting to load stage NONE [17:56:15:085310]:[Assets] ResourceManager.cpp(1006)::loadStageInternal : Loading empty scene since NONE specified as filename. [17:56:15:085317]:[Sim] Simulator.cpp(439)::instanceStageForSceneAttributes : Successfully loaded stage named : NONE [17:56:15:085332]:[Sim] Simulator.cpp(205)::reconfigure : CreateSceneInstance success == true for active scene name : NONE with renderer. [17:56:15:087145]:[Metadata] AttributesManagerBase.h(321)::loadAllTemplatesFromPathAndExt : : ParsingObject Template: Cannot find /raid/nerf/habitat-sim/data/objects/example_objects as directory or /raid/nerf/habitat-sim/data/objects/example_objects.object_config.json as config file. Aborting parse. Dropdown(description='Available Scenes:', layout=Layout(width='max-content'), options=('NONE',), style=DescriptionStyle(description_width='300px'), value='NONE') Encoding the video: /raid/nerf/habitat-sim/examples/tutorials/replica_cad_output/ReplicaCAD_scene_view.mp4 Error: no "view" mailcap rules found for type "video/mp4" /usr/bin/xdg-open: 869: x-www-browser: not found /usr/bin/xdg-open: 869: firefox: not found /usr/bin/xdg-open: 869: iceweasel: not found /usr/bin/xdg-open: 869: seamonkey: not found /usr/bin/xdg-open: 869: mozilla: not found /usr/bin/xdg-open: 869: epiphany: not found /usr/bin/xdg-open: 869: konqueror: not found /usr/bin/xdg-open: 869: chromium: not found /usr/bin/xdg-open: 869: chromium-browser: not found /usr/bin/xdg-open: 869: google-chrome: not found /usr/bin/xdg-open: 869: www-browser: not found /usr/bin/xdg-open: 869: links2: not found /usr/bin/xdg-open: 869: elinks: not found /usr/bin/xdg-open: 869: links: not found /usr/bin/xdg-open: 869: lynx: not found /usr/bin/xdg-open: 869: w3m: not found xdg-open: no method available for opening '/raid/nerf/habitat-sim/examples/tutorials/replica_cad_output/ReplicaCAD_scene_view.mp4' [17:56:16:750474]:[Sim] Simulator.cpp(66)::~Simulator : Deconstructing Simulator [17:56:16:750566]:[Physics] PhysicsManager.cpp(50)::~PhysicsManager : Deconstructing PhysicsManager [17:56:16:750617]:[Scene] SceneManager.h(25)::~SceneManager : Deconstructing SceneManager [17:56:16:750626]:[Scene] SceneGraph.h(25)::~SceneGraph : Deconstructing SceneGraph [17:56:16:751139]:[Sensor] Sensor.cpp(69)::~Sensor : Deconstructing Sensor [17:56:16:751282]:[Gfx] Renderer.cpp(72)::~Impl : Deconstructing Renderer [17:56:16:751300]:[Gfx] WindowlessContext.h(17)::~WindowlessContext : Deconstructing WindowlessContext

aclegg3 commented 1 year ago

Hey @ykaganov Looks like your dataset paths are not setup correctly:

AttributesManagerBase.h(380)::createFromJsonOrDefaultInternal : : Proposing JSON name : data/replica_cad/replicaCAD.scene_dataset_config.json from original name : data/replica_cad/replicaCAD.scene_dataset_config.json| This file does not exist.

If you ran exactly python -m habitat_sim.utils.datasets_download --uids replica_cad_dataset replica_cad --data-path /path/to/data/ then the dataset would be downloaded to absolute path /path/to/data/ Instead, if you intend to run this tutorial, you should run: python -m habitat_sim.utils.datasets_download --uids replica_cad_dataset replica_cad using the default data path from the habitat-sim directory.