search

facebookresearch / sound-spaces

A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple tasks and applications.
https://soundspaces.org
Creative Commons Attribution 4.0 International
322 stars 55 forks source link

where is data/scene_observations #103

Open WHUfreeway opened 1 year ago

WHUfreeway commented 1 year ago

when i installed soundspaces0.1.2 with habitat-0.1.7, after downloading dataset, I tryed to start to train the model, but a problem occured： speaks that I lose file 'data/scene_observation/replica/apartment_0.pkl' where can i get these files? and when i tryed to just to run the pretrained models as instruction 4 'Generate demo video with audio', problem also occured that raise an EOF error.

here is my console output: (habitat_cuda) fyw@7049GP-TRT:/data1/fyw/soundspaces/sound-spaces-0.1.2$ python ss_baselines/av_nav/run.py --exp-config ss_baselines/av_nav/config/audionav/replica/train_telephone/audiogoal_depth.yaml --model-dir data/models/replica/audiogoal_depth 2022-12-19 22:56:16.318318: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2022-12-19 22:56:16.475771: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0. 2022-12-19 22:56:17.063157: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:17.063246: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:17.063257: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. data/models/replica/audiogoal_depth/tb exists data/models/replica/audiogoal_depth/data exists Output directory already exists! Overwrite the folder? (y/n)y 2022-12-19 22:56:20,932 config: BASE_TASK_CONFIG_PATH: configs/audionav/av_nav/replica/audiogoal.yaml CHECKPOINT_FOLDER: data/models/replica/audiogoal_depth/data CHECKPOINT_INTERVAL: 50 CMD_TRAILING_OPTS: [] DEBUG: False DISPLAY_RESOLUTION: 128 ENV_NAME: AudioNavRLEnv EVAL: SPLIT: val USE_CKPT_CONFIG: True EVAL_CKPT_PATH_DIR: data/models/replica/audiogoal_depth/data EXTRA_RGB: False LOG_FILE: data/models/replica/audiogoal_depth/train.log LOG_INTERVAL: 10 NUM_PROCESSES: 5 NUM_UPDATES: 40000 RL: DISTANCE_REWARD_SCALE: 1.0 PPO: clip_param: 0.1 entropy_coef: 0.2 eps: 1e-05 gamma: 0.99 hidden_size: 512 lr: 0.00025 max_grad_norm: 0.5 num_mini_batch: 1 num_steps: 150 ppo_epoch: 4 reward_window_size: 50 tau: 0.95 use_gae: True use_linear_clip_decay: True use_linear_lr_decay: True value_loss_coef: 0.5 SLACK_REWARD: -0.01 SUCCESS_REWARD: 10.0 TIME_DIFF: False WITH_DISTANCE_REWARD: True WITH_TIME_PENALTY: True SEED: 0 SENSORS: ['DEPTH_SENSOR'] SIMULATOR_GPU_ID: 0 TASK_CONFIG: DATASET: CONTENT_SCENES: ['*'] DATA_PATH: data/datasets/audionav/replica/{version}/{split}/{split}.json.gz SCENES_DIR: data/scene_datasets/replica SPLIT: train_telephone TYPE: AudioNav VERSION: v1 ENVIRONMENT: ITERATOR_OPTIONS: CYCLE: True GROUP_BY_SCENE: True MAX_SCENE_REPEAT_EPISODES: -1 MAX_SCENE_REPEAT_STEPS: 10000 NUM_EPISODE_SAMPLE: -1 SHUFFLE: True STEP_REPETITION_RANGE: 0.2 MAX_EPISODE_SECONDS: 10000000 MAX_EPISODE_STEPS: 500 PYROBOT: BASE_CONTROLLER: proportional BASE_PLANNER: none BUMP_SENSOR: TYPE: PyRobotBumpSensor DEPTH_SENSOR: CENTER_CROP: False HEIGHT: 480 MAX_DEPTH: 5.0 MIN_DEPTH: 0.0 NORMALIZE_DEPTH: True TYPE: PyRobotDepthSensor WIDTH: 640 LOCOBOT: ACTIONS: ['BASE_ACTIONS', 'CAMERA_ACTIONS'] BASE_ACTIONS: ['go_to_relative', 'go_to_absolute'] CAMERA_ACTIONS: ['set_pan', 'set_tilt', 'set_pan_tilt'] RGB_SENSOR: CENTER_CROP: False HEIGHT: 480 TYPE: PyRobotRGBSensor WIDTH: 640 ROBOT: locobot ROBOTS: ['locobot'] SENSORS: ['RGB_SENSOR', 'DEPTH_SENSOR', 'BUMP_SENSOR'] SEED: 100 SIMULATOR: ACTION_SPACE_CONFIG: v0 AGENTS: ['AGENT_0'] AGENT_0: ANGULAR_ACCELERATION: 12.56 ANGULAR_FRICTION: 1.0 COEFFICIENT_OF_RESTITUTION: 0.0 HEIGHT: 1.5 IS_SET_START_STATE: False LINEAR_ACCELERATION: 20.0 LINEAR_FRICTION: 0.5 MASS: 32.0 RADIUS: 0.1 SENSORS: ['RGB_SENSOR'] START_POSITION: [0, 0, 0] START_ROTATION: [0, 0, 0, 1] AUDIO: BINAURAL_RIR_DIR: data/binaural_rirs EVERLASTING: True GRAPH_FILE: graph.pkl HAS_DISTRACTOR_SOUND: False METADATA_DIR: data/metadata POINTS_FILE: points.txt RIR_SAMPLING_RATE: 44100 SCENE: SOURCE_SOUND_DIR: data/sounds/1s_all CONTINUOUS_VIEW_CHANGE: False DEFAULT_AGENT_ID: 0 DEPTH_SENSOR: HEIGHT: 128 HFOV: 90 MAX_DEPTH: 10.0 MIN_DEPTH: 0.0 NORMALIZE_DEPTH: True ORIENTATION: [0.0, 0.0, 0.0] POSITION: [0, 1.25, 0] TYPE: HabitatSimDepthSensor WIDTH: 128 FORWARD_STEP_SIZE: 0.5 GRID_SIZE: 0.5 HABITAT_SIM_V0: ALLOW_SLIDING: True ENABLE_PHYSICS: False GPU_DEVICE_ID: 0 GPU_GPU: False PHYSICS_CONFIG_FILE: ./data/default.physics_config.json RGB_SENSOR: HEIGHT: 128 HFOV: 90 ORIENTATION: [0.0, 0.0, 0.0] POSITION: [0, 1.25, 0] TYPE: HabitatSimRGBSensor WIDTH: 128 SCENE: data/scene_datasets/habitat-test-scenes/van-gogh-room.glb SCENE_DATASET: replica SCENE_OBSERVATION_DIR: data/scene_observations SEED: 100 SEMANTIC_SENSOR: HEIGHT: 480 HFOV: 90 ORIENTATION: [0.0, 0.0, 0.0] POSITION: [0, 1.25, 0] TYPE: HabitatSimSemanticSensor WIDTH: 640 TILT_ANGLE: 15 TURN_ANGLE: 10 TYPE: SoundSpacesSim USE_RENDERED_OBSERVATIONS: True USE_SYNC_VECENV: False VIEW_CHANGE_FPS: 10 TASK: ACTIONS: ANSWER: TYPE: AnswerAction LOOK_DOWN: TYPE: LookDownAction LOOK_UP: TYPE: LookUpAction MOVE_FORWARD: TYPE: MoveForwardAction STOP: TYPE: StopAction TELEPORT: TYPE: TeleportAction TURN_LEFT: TYPE: TurnLeftAction TURN_RIGHT: TYPE: TurnRightAction ANSWER_ACCURACY: TYPE: AnswerAccuracy AUDIOGOAL_SENSOR: TYPE: AudioGoalSensor COLLISIONS: TYPE: Collisions COMPASS_SENSOR: TYPE: CompassSensor CORRECT_ANSWER: TYPE: CorrectAnswer DISTANCE_TO_GOAL: DISTANCE_TO: POINT TYPE: DistanceToGoal EPISODE_INFO: TYPE: EpisodeInfo GOAL_SENSOR_UUID: spectrogram GPS_SENSOR: DIMENSIONALITY: 2 TYPE: GPSSensor HEADING_SENSOR: TYPE: HeadingSensor IMAGEGOAL_SENSOR: TYPE: ImageGoalSensor INSTRUCTION_SENSOR: TYPE: InstructionSensor INSTRUCTION_SENSOR_UUID: instruction MEASUREMENTS: ['DISTANCE_TO_GOAL', 'NORMALIZED_DISTANCE_TO_GOAL', 'SUCCESS', 'SPL', 'SOFT_SPL', 'NUM_ACTION', 'SUCCESS_WEIGHTED_BY_NUM_ACTION'] NORMALIZED_DISTANCE_TO_GOAL: TYPE: NormalizedDistanceToGoal NUM_ACTION: TYPE: NA OBJECTGOAL_SENSOR: GOAL_SPEC: TASK_CATEGORY_ID GOAL_SPEC_MAX_VAL: 50 TYPE: ObjectGoalSensor POINTGOAL_SENSOR: DIMENSIONALITY: 2 GOAL_FORMAT: POLAR TYPE: PointGoalSensor POINTGOAL_WITH_GPS_COMPASS_SENSOR: DIMENSIONALITY: 2 GOAL_FORMAT: POLAR TYPE: PointGoalWithGPSCompassSensor POSSIBLE_ACTIONS: ['STOP', 'MOVE_FORWARD', 'TURN_LEFT', 'TURN_RIGHT'] PROXIMITY_SENSOR: MAX_DETECTION_RADIUS: 2.0 TYPE: ProximitySensor QUESTION_SENSOR: TYPE: QuestionSensor SENSORS: ['SPECTROGRAM_SENSOR'] SOFT_SPL: TYPE: SoftSPL SPECTROGRAM_SENSOR: TYPE: SpectrogramSensor SPL: SUCCESS_DISTANCE: 0.2 TYPE: SPL SUCCESS: SUCCESS_DISTANCE: 0.2 TYPE: Success SUCCESS_DISTANCE: 0.2 SUCCESS_WEIGHTED_BY_NUM_ACTION: TYPE: SNA TOP_DOWN_MAP: DRAW_BORDER: True DRAW_GOAL_AABBS: True DRAW_GOAL_POSITIONS: True DRAW_SHORTEST_PATH: True DRAW_SOURCE: True DRAW_SOURCE_AND_TARGET: True DRAW_VIEW_POINTS: True FOG_OF_WAR: DRAW: True FOV: 90 VISIBILITY_DIST: 5.0 MAP_PADDING: 3 MAP_RESOLUTION: 10000 MAX_EPISODE_STEPS: 1000 TYPE: TopDownMap TYPE: AudioNav TENSORBOARD_DIR: data/models/replica/audiogoal_depth/tb TEST_EPISODE_COUNT: 2 TORCH_GPU_ID: 0 TRAINER_NAME: AVNavTrainer USE_LAST_CKPT: False USE_SYNC_VECENV: False USE_VECENV: True VIDEO_DIR: data/models/replica/audiogoal_depth/video_dir VIDEO_OPTION: [] VISUALIZATION_OPTION: [] 2022-12-19 22:56:20,933 Initializing dataset AudioNav 2022-12-19 22:56:20, INFO: Using VectorEnv 2022-12-19 22:56:23.734928: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2022-12-19 22:56:23.741468: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2022-12-19 22:56:23.780980: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2022-12-19 22:56:23.817418: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2022-12-19 22:56:23.875324: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2022-12-19 22:56:23.898933: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0. 2022-12-19 22:56:23.902790: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0. 2022-12-19 22:56:23.917278: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0. 2022-12-19 22:56:23.970617: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0. 2022-12-19 22:56:24.035279: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0. 2022-12-19 22:56:24.643324: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.643448: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.643460: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. 2022-12-19 22:56:24.651956: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.652052: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.652065: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. 2022-12-19 22:56:24.652287: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.652382: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.652394: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. 2022-12-19 22:56:24.729861: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.729981: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.729994: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. 2022-12-19 22:56:24.792559: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.792655: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64: 2022-12-19 22:56:24.792667: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. 2022-12-19 22:56:25,091 Initializing dataset AudioNav 2022-12-19 22:56:25,092 Initializing dataset AudioNav 2022-12-19 22:56:25,105 Initializing dataset AudioNav 2022-12-19 22:56:25,170 Initializing dataset AudioNav 2022-12-19 22:56:25,233 Initializing dataset AudioNav 2022-12-19 22:56:25, INFO: Sampled 13132 from frl_apartment_2 2022-12-19 22:56:25, INFO: Sampled 1892 from room_0 2022-12-19 22:56:25,442 initializing sim SoundSpacesSim Process ForkServerProcess-4: Traceback (most recent call last): File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, self._kwargs) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner return func(*args, *kwds) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env env = env_fn(env_fn_args) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn env = env_class(config=config, dataset=dataset) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init super().init(self._core_env_config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init self._env = Env(config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim return _sim(kwargs) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init with open(self.current_scene_observation_file, 'rb') as fo: FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/frl_apartment_2.pkl' 2022-12-19 22:56:25, INFO: Sampled 13882 from frl_apartment_1 2022-12-19 22:56:25, INFO: Sampled 1526 from hotel_0 2022-12-19 22:56:25, INFO: Sampled 13670 from frl_apartment_0 2022-12-19 22:56:25,496 initializing sim SoundSpacesSim Process ForkServerProcess-3: Traceback (most recent call last): File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, self._kwargs) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner return func(*args, *kwds) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env env = env_fn(env_fn_args) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn env = env_class(config=config, dataset=dataset) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init super().init(self._core_env_config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init self._env = Env(config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim return _sim(kwargs) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init with open(self.current_scene_observation_file, 'rb') as fo: FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/hotel_0.pkl' 2022-12-19 22:56:25, INFO: Sampled 17220 from frl_apartment_3 2022-12-19 22:56:25,659 initializing sim SoundSpacesSim Process ForkServerProcess-5: Traceback (most recent call last): File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, self._kwargs) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner return func(*args, *kwds) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env env = env_fn(env_fn_args) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn env = env_class(config=config, dataset=dataset) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init super().init(self._core_env_config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init self._env = Env(config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim return _sim(kwargs) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init with open(self.current_scene_observation_file, 'rb') as fo: FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/frl_apartment_3.pkl' 2022-12-19 22:56:25, INFO: Sampled 4360 from office_4 2022-12-19 22:56:25,737 initializing sim SoundSpacesSim Process ForkServerProcess-2: Traceback (most recent call last): File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, self._kwargs) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner return func(*args, *kwds) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env env = env_fn(env_fn_args) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn env = env_class(config=config, dataset=dataset) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init super().init(self._core_env_config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init self._env = Env(config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim return _sim(kwargs) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init with open(self.current_scene_observation_file, 'rb') as fo: FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/office_4.pkl' 2022-12-19 22:56:26, INFO: Sampled 40748 from apartment_0 2022-12-19 22:56:26, INFO: Sampled 388 from office_0 2022-12-19 22:56:26,288 initializing sim SoundSpacesSim Process ForkServerProcess-1: Traceback (most recent call last): File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, self._kwargs) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner return func(*args, *kwds) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env env = env_fn(env_fn_args) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn env = env_class(config=config, dataset=dataset) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init super().init(self._core_env_config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init self._env = Env(config, dataset) File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim return _sim(kwargs) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init with open(self.current_scene_observation_file, 'rb') as fo: FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/apartment_0.pkl' Traceback (most recent call last): File "ss_baselines/av_nav/run.py", line 101, in main() File "ss_baselines/av_nav/run.py", line 95, in main trainer.train() File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/av_nav/ppo/ppo_trainer.py", line 234, in train self.config, get_env_class(self.config.ENV_NAME) File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 102, in construct_envs auto_reset_done=auto_reset_done File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 194, in init read_fn() for read_fn in self._connection_read_fns File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 194, in read_fn() for read_fn in self._connection_read_fns File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 97, in call res = self.read_fn() File "/data1/fyw/soundspaces/habitat-lab/habitat/utils/pickle5_multiprocessing.py", line 68, in recv buf = self.recv_bytes() File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 216, in recv_bytes buf = self._recv_bytes(maxlength) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 407, in _recv_bytes buf = self._recv(4) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 379, in _recv chunk = read(handle, remaining) ConnectionResetError: [Errno 104] Connection reset by peer Exception ignored in: <function VectorEnv.del at 0x7fc15fa98950> Traceback (most recent call last): File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 588, in del self.close() File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 456, in close read_fn() File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 97, in call res = self.read_fn() File "/data1/fyw/soundspaces/habitat-lab/habitat/utils/pickle5_multiprocessing.py", line 68, in recv buf = self.recv_bytes() File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 216, in recv_bytes buf = self._recv_bytes(maxlength) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 407, in _recv_bytes buf = self._recv(4) File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 383, in _recv raise EOFError

ChanganVR commented 1 year ago

@WHUfreeway scene_observations are the rendered RGB-D images for all pairs of points in each scene. You need to run this script to cache the observations. Furthermore, check this step-by-step installation guide for instructions.

Let me know if you have other questions!

sheldonwuchiha commented 3 months ago

@ChanganVR I am a little confused about when I run this script, the bug comes out saying HabitatSimRGBSensor object has no attribute _getdefault_spec, I used habitat-0.1.7,too