Can't create vaild camera trajectory

Zhuct23 commented 6 months ago

Hi Mike, thank you very much for your exceptional work. When I try to run example1 in my own scene, I encounter some issues. When I ran python ../../code/python/tools/dataset_generate_camera_trajectories.py --dataset_dir . --scene_names AI61_004 --use_python_reference_implementation, it has the following logs.

(hypersim-env) (base) zhuct@z:/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset$ python ../../code/python/tools/dataset_generate_camera_trajectories.py --dataset_dir . --scene_names AI61_004 [HYPERSIM: DATASET_GENERATE_CAMERA_TRAJECTORIES] Begin... [Parallel(n_jobs=4)]: Using backend LokyBackend with 4 concurrent workers. /home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 scene_generate_camera_trajectories_random_walk.py --scene_dir /media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004 [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Begin... [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam001, output camera cam_00... /media/zhuct/新加卷/linux/Project/ml-hypersim/code/cpp/bin/generate_camera_trajectory_random_walk --mesh_vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_vertices.hdf5 --mesh_faces_vi_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_faces_vi.hdf5 --start_camera_position_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_position.hdf5 --start_camera_orientation_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_orientation.hdf5 --camera_rays_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays.hdf5 --camera_rays_distances_to_center_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays_distances_to_center.hdf5 --octomap_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_detail/octomap/octomap.bt --octomap_free_space_min_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_min.hdf5 --octomap_free_space_max_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_max.hdf5 --n_samples_random_walk=100 --n_samples_octomap_query=1000 --n_samples_camera_pose_candidates=20 --n_voxel_size=10.000000223517425 --n_query_half_extent_relative_to_start_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_start.hdf5 --n_query_half_extent_relative_to_current_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_current.hdf5 --output_camera_look_from_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_from_positions.hdf5 --output_camera_look_at_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_at_positions.hdf5 --output_camera_orientations_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_orientations.hdf5 --output_intersection_distances_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_intersection_distances.hdf5 --output_prim_ids_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_prim_ids.hdf5 [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Begin... [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Constructing Embree data... [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP. [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. GIVING UP. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: random_walk_utils.generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. SKIPPING. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam002, output camera cam_01... /media/zhuct/新加卷/linux/Project/ml-hypersim/code/cpp/bin/generate_camera_trajectory_random_walk --mesh_vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_vertices.hdf5 --mesh_faces_vi_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_faces_vi.hdf5 --start_camera_position_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_position.hdf5 --start_camera_orientation_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_orientation.hdf5 --camera_rays_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays.hdf5 --camera_rays_distances_to_center_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays_distances_to_center.hdf5 --octomap_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_detail/octomap/octomap.bt --octomap_free_space_min_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_min.hdf5 --octomap_free_space_max_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_max.hdf5 --n_samples_random_walk=100 --n_samples_octomap_query=1000 --n_samples_camera_pose_candidates=20 --n_voxel_size=10.000000223517425 --n_query_half_extent_relative_to_start_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_start.hdf5 --n_query_half_extent_relative_to_current_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_current.hdf5 --output_camera_look_from_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_from_positions.hdf5 --output_camera_look_at_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_at_positions.hdf5 --output_camera_orientations_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_orientations.hdf5 --output_intersection_distances_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_intersection_distances.hdf5 --output_prim_ids_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_prim_ids.hdf5 [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Begin... [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Constructing Embree data... [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP. [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. GIVING UP. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: random_walk_utils.generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. SKIPPING. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam003_closeup, output camera cam_02... /media/zhuct/新加卷/linux/Project/ml-hypersim/code/cpp/bin/generate_camera_trajectory_random_walk --mesh_vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_vertices.hdf5 --mesh_faces_vi_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_faces_vi.hdf5 --start_camera_position_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_position.hdf5 --start_camera_orientation_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_orientation.hdf5 --camera_rays_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays.hdf5 --camera_rays_distances_to_center_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays_distances_to_center.hdf5 --octomap_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_detail/octomap/octomap.bt --octomap_free_space_min_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_min.hdf5 --octomap_free_space_max_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_max.hdf5 --n_samples_random_walk=100 --n_samples_octomap_query=1000 --n_samples_camera_pose_candidates=20 --n_voxel_size=10.000000223517425 --n_query_half_extent_relative_to_start_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_start.hdf5 --n_query_half_extent_relative_to_current_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_current.hdf5 --output_camera_look_from_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_from_positions.hdf5 --output_camera_look_at_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_at_positions.hdf5 --output_camera_orientations_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_orientations.hdf5 --output_intersection_distances_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_intersection_distances.hdf5 --output_prim_ids_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_prim_ids.hdf5 [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Begin... [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Constructing Embree data... [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP. [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. GIVING UP. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: random_walk_utils.generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. SKIPPING. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam004_closeup, output camera cam_03... /media/zhuct/新加卷/linux/Project/ml-hypersim/code/cpp/bin/generate_camera_trajectory_random_walk --mesh_vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_vertices.hdf5 --mesh_faces_vi_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_faces_vi.hdf5 --start_camera_position_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_position.hdf5 --start_camera_orientation_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_orientation.hdf5 --camera_rays_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays.hdf5 --camera_rays_distances_to_center_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays_distances_to_center.hdf5 --octomap_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_detail/octomap/octomap.bt --octomap_free_space_min_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_min.hdf5 --octomap_free_space_max_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_max.hdf5 --n_samples_random_walk=100 --n_samples_octomap_query=1000 --n_samples_camera_pose_candidates=20 --n_voxel_size=10.000000223517425 --n_query_half_extent_relative_to_start_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_start.hdf5 --n_query_half_extent_relative_to_current_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_current.hdf5 --output_camera_look_from_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_from_positions.hdf5 --output_camera_look_at_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_at_positions.hdf5 --output_camera_orientations_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_orientations.hdf5 --output_intersection_distances_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_intersection_distances.hdf5 --output_prim_ids_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_prim_ids.hdf5 [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Begin... [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Constructing Embree data... [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP. [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] [HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. GIVING UP. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: random_walk_utils.generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. SKIPPING. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Finished. [Parallel(n_jobs=4)]: Done 1 tasks | elapsed: 23.6s [Parallel(n_jobs=4)]: Done 1 out of 1 | elapsed: 23.7s finished [HYPERSIM: DATASET_GENERATE_CAMERA_TRAJECTORIES] Finished. (hypersim-env) (base) zhuct@z:/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset$ python ../../code/python/tools/dataset_generate_camera_trajectories.py --dataset_dir . --scene_names AI61_004 --use_python_reference_implementation [HYPERSIM: DATASET_GENERATE_CAMERA_TRAJECTORIES] Begin... [Parallel(n_jobs=4)]: Using backend LokyBackend with 4 concurrent workers. /home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 scene_generate_camera_trajectories_random_walk.py --scene_dir /media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004 --use_python_reference_implementation [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Begin... [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam001, output camera cam_00... [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam002, output camera cam_00... [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam003_closeup, output camera cam_00... [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam004_closeup, output camera cam_00... [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP. [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] [HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Finished. [Parallel(n_jobs=4)]: Done 1 tasks | elapsed: 45.7s [Parallel(n_jobs=4)]: Done 1 out of 1 | elapsed: 45.7s finished [HYPERSIM: DATASET_GENERATE_CAMERA_TRAJECTORIES] Finished.

According to the logs, the camera's line of sight did not detect any scene, but the scene was visible in the rendered image under the initial camera

AI61_004_Cam04 AI61_004_Cam03 AI61_004_Cam02 AI61_004_Cam01

The mesh representation of the scene is as follows.

mesh

The otcomap of the scene is as follows.

octomap

Can you give me some advice on how to solve this problem. Is it because this scene is too complex or too simple？Or is it due to parameter issues?

mikeroberts3000 commented 5 months ago

Hi. Great question, and this is a great-looking scene. (It appears to be newer than the official Hypersim scenes.) Can you please format the log output as a multi-line code block so it's more readable? That will help me and other readers. Thanks.

Zhuct23 commented 5 months ago

The log output is as follows.

(hypersim-env) (base) zhuct@z:/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset$ python ../../code/python/tools/dataset_generate_camera_trajectories.py --dataset_dir . --scene_names AI61_004
[HYPERSIM: DATASET_GENERATE_CAMERA_TRAJECTORIES] Begin...
[Parallel(n_jobs=4)]: Using backend LokyBackend with 4 concurrent workers.

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 scene_generate_camera_trajectories_random_walk.py --scene_dir /media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004 

[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Begin...
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam001, output camera cam_00...

/media/zhuct/新加卷/linux/Project/ml-hypersim/code/cpp/bin/generate_camera_trajectory_random_walk --mesh_vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_vertices.hdf5 --mesh_faces_vi_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_faces_vi.hdf5 --start_camera_position_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_position.hdf5 --start_camera_orientation_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_orientation.hdf5 --camera_rays_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays.hdf5 --camera_rays_distances_to_center_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays_distances_to_center.hdf5 --octomap_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_detail/octomap/octomap.bt --octomap_free_space_min_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_min.hdf5 --octomap_free_space_max_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_max.hdf5 --n_samples_random_walk=100 --n_samples_octomap_query=1000 --n_samples_camera_pose_candidates=20 --n_voxel_size=10.000000223517425 --n_query_half_extent_relative_to_start_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_start.hdf5 --n_query_half_extent_relative_to_current_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_current.hdf5 --output_camera_look_from_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_from_positions.hdf5 --output_camera_look_at_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_at_positions.hdf5 --output_camera_orientations_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_orientations.hdf5 --output_intersection_distances_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_intersection_distances.hdf5 --output_prim_ids_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_prim_ids.hdf5

[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Begin...
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Constructing Embree data...
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP.
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. GIVING UP.
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: random_walk_utils.generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. SKIPPING.
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam002, output camera cam_01...

/media/zhuct/新加卷/linux/Project/ml-hypersim/code/cpp/bin/generate_camera_trajectory_random_walk --mesh_vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_vertices.hdf5 --mesh_faces_vi_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_faces_vi.hdf5 --start_camera_position_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_position.hdf5 --start_camera_orientation_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_orientation.hdf5 --camera_rays_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays.hdf5 --camera_rays_distances_to_center_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays_distances_to_center.hdf5 --octomap_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_detail/octomap/octomap.bt --octomap_free_space_min_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_min.hdf5 --octomap_free_space_max_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_max.hdf5 --n_samples_random_walk=100 --n_samples_octomap_query=1000 --n_samples_camera_pose_candidates=20 --n_voxel_size=10.000000223517425 --n_query_half_extent_relative_to_start_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_start.hdf5 --n_query_half_extent_relative_to_current_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_current.hdf5 --output_camera_look_from_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_from_positions.hdf5 --output_camera_look_at_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_at_positions.hdf5 --output_camera_orientations_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_orientations.hdf5 --output_intersection_distances_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_intersection_distances.hdf5 --output_prim_ids_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_prim_ids.hdf5

[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Begin...
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Constructing Embree data...
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP.
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. GIVING UP.
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: random_walk_utils.generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. SKIPPING.
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam003_closeup, output camera cam_02...

/media/zhuct/新加卷/linux/Project/ml-hypersim/code/cpp/bin/generate_camera_trajectory_random_walk --mesh_vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_vertices.hdf5 --mesh_faces_vi_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_faces_vi.hdf5 --start_camera_position_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_position.hdf5 --start_camera_orientation_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_orientation.hdf5 --camera_rays_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays.hdf5 --camera_rays_distances_to_center_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays_distances_to_center.hdf5 --octomap_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_detail/octomap/octomap.bt --octomap_free_space_min_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_min.hdf5 --octomap_free_space_max_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_max.hdf5 --n_samples_random_walk=100 --n_samples_octomap_query=1000 --n_samples_camera_pose_candidates=20 --n_voxel_size=10.000000223517425 --n_query_half_extent_relative_to_start_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_start.hdf5 --n_query_half_extent_relative_to_current_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_current.hdf5 --output_camera_look_from_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_from_positions.hdf5 --output_camera_look_at_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_at_positions.hdf5 --output_camera_orientations_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_orientations.hdf5 --output_intersection_distances_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_intersection_distances.hdf5 --output_prim_ids_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_prim_ids.hdf5

[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Begin...
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Constructing Embree data...
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP.
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. GIVING UP.
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: random_walk_utils.generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. SKIPPING.
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam004_closeup, output camera cam_03...

/media/zhuct/新加卷/linux/Project/ml-hypersim/code/cpp/bin/generate_camera_trajectory_random_walk --mesh_vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_vertices.hdf5 --mesh_faces_vi_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_mesh_faces_vi.hdf5 --start_camera_position_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_position.hdf5 --start_camera_orientation_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_start_camera_orientation.hdf5 --camera_rays_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays.hdf5 --camera_rays_distances_to_center_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_camera_rays_distances_to_center.hdf5 --octomap_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_detail/octomap/octomap.bt --octomap_free_space_min_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_min.hdf5 --octomap_free_space_max_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_octomap_free_space_max.hdf5 --n_samples_random_walk=100 --n_samples_octomap_query=1000 --n_samples_camera_pose_candidates=20 --n_voxel_size=10.000000223517425 --n_query_half_extent_relative_to_start_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_start.hdf5 --n_query_half_extent_relative_to_current_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_n_query_half_extent_relative_to_current.hdf5 --output_camera_look_from_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_from_positions.hdf5 --output_camera_look_at_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_look_at_positions.hdf5 --output_camera_orientations_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_camera_orientations.hdf5 --output_intersection_distances_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_intersection_distances.hdf5 --output_prim_ids_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_prim_ids.hdf5

[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Begin...
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] Constructing Embree data...
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: CAMERA DOESN'T OBSERVE ANY PART OF THE SCENE. ALL INTERSECTION DISTANCES ARE AT INFINITY. GIVING UP.
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK]
[HYPERSIM: GENERATE_CAMERA_TRAJECTORY_RANDOM_WALK] WARNING: generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. GIVING UP.
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] WARNING: random_walk_utils.generate_camera_trajectory_random_walk DID NOT EXECUTE SUCCESSFULLY. SKIPPING.
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Finished.
[Parallel(n_jobs=4)]: Done   1 tasks      | elapsed:   48.6s
[Parallel(n_jobs=4)]: Done   1 out of   1 | elapsed:   48.7s finished
[HYPERSIM: DATASET_GENERATE_CAMERA_TRAJECTORIES] Finished.

Could you give me some suggestions to solve this problems?

mikeroberts3000 commented 5 months ago

That output is much easier to read. Thank you.

This scene is newer than any of the official Hypersim scenes, so I've never worked with it directly. But our pipeline should still work. I wrote up some additional details on how we generate camera trajectories in https://github.com/apple/ml-hypersim/issues/67. This is the part of the code that is failing here, so it may be worth reading that post to understand what our code is trying to do in more detail.

From the warning messages you posted, we can see that our code doesn't think that the artist-provided camera poses can observe any scene geometry. We need to be able to see at least one pixel of scene geometry from each artist-provided camera pose to proceed, see https://github.com/apple/ml-hypersim/issues/67 for details.

So, are we encountering problems because of the artist-provided camera poses, or the scene geometry? On the one hand, the artist-provided camera poses look fine, based on the rendered image results you posted. On the other hand, the scene geometry also looks fine, based on what you get from running our visualize_* tools on the scene.

Where did you get those rendered images? Did you render them yourself? If you rendered them yourself from the command-line, what were the exact command-line parameters you used?

As a quick sanity check, you should be able to visualize the artist-provided camera poses using our visualize_camera_trajectory.py tool. Just set --camera_dir to any of the following paths:

/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_asset_export/cam_AI61_004_VRayCam001
/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_asset_export/cam_AI61_004_VRayCam002
/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_asset_export/cam_AI61_004_VRayCam003_closeup
/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_asset_export/cam_AI61_004_VRayCam004_closeup

For each of these paths, you should see exactly one camera pose when you launch the visualize_camera_trajectory.py tool. Does the camera pose look like it is in the right place, i.e., does it roughly match the pose implied by the corresponding rendered image? If it is difficult to navigate through the scene because the triangle mesh is too big, it is easy to hack our tool to subsample the mesh to only process 1 in K triangles for some reasonable choice of K.

Zhuct23 commented 5 months ago

Thank you for your quick reply!

The rendered image mentioned above is not self rendered, they are included in the scene file. I have rendered one image using the python ../../code/python/tools/dataset_render_scene.py --dataset_dir . --scene_name AI61_006 --render_pass none --save_image. The result is as follows.

frame

I have checked the camera pose look, and it looks right.
I have found the problem for the warning, It's the problem of the embree3. Maybe I mistakenly installed Embree. I change the ray intersection part, using open3d, It found the intersection point, but I have encountered another problem. The pipeline can only generate three camera trajectories.

(hypersim-env) (base) zhuct@z:/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset$ python ../../code/python/tools/dataset_generate_camera_trajectories.py --dataset_dir . --scene_names AI61_004 --use_python_reference_implementation
[HYPERSIM: DATASET_GENERATE_CAMERA_TRAJECTORIES] Begin...
[Parallel(n_jobs=4)]: Using backend LokyBackend with 4 concurrent workers.

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 scene_generate_camera_trajectories_random_walk.py --scene_dir /media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004 --use_python_reference_implementation

[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Begin...
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] Input camera cam_AI61_004_VRayCam001, output camera cam_00...

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] j = 1

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] j = 2

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...
[HYPERSIM: SCENE_GENERATE_CAMERA_TRAJECTORIES_RANDOM_WALK] j = 3

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...

/home/zhuct/anaconda3/envs/hypersim-env/bin/python3.7 /media/zhuct/新加卷/linux/Project/ml-hypersim/code/python/tools/ray_intersection.py --vertices_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_vertices.hdf5 --faces_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_faces.hdf5 --ray_positions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_positions.hdf5 --ray_directions_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_ray_directions.hdf5 --output_ray_hit_data_float_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_float.hdf5 --output_ray_hit_data_int_file=/media/zhuct/新加卷/linux/Project/ml-hypersim/examples/my_dataset/scenes/AI61_004/_tmp/_tmp_output_ray_hit_data_int.hdf5

[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Begin...
[HYPERSIM: GENERATE_RAY_INTERSECTIONS] Saving intersection data...
Traceback (most recent call last):
  File "scene_generate_camera_trajectories_random_walk.py", line 489, in <module>
    assert query_positions.shape[0] > 0
AssertionError
[Parallel(n_jobs=4)]: Done   1 tasks      | elapsed:  2.5min
joblib.externals.loky.process_executor._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/site-packages/joblib/externals/loky/process_executor.py", line 436, in _process_worker
    r = call_item()
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/site-packages/joblib/externals/loky/process_executor.py", line 288, in __call__
    return self.fn(*self.args, **self.kwargs)
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/site-packages/joblib/_parallel_backends.py", line 595, in __call__
    return self.func(*args, **kwargs)
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/site-packages/joblib/parallel.py", line 264, in __call__
    for func, args, kwargs in self.items]
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/site-packages/joblib/parallel.py", line 264, in <listcomp>
    for func, args, kwargs in self.items]
  File "../../code/python/tools/dataset_generate_camera_trajectories.py", line 74, in process_scene
    assert retval == 0
AssertionError
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "../../code/python/tools/dataset_generate_camera_trajectories.py", line 86, in <module>
    Parallel(n_jobs=n_jobs, verbose=10)(delayed(process_scene)(s, args) for s in scenes)
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/site-packages/joblib/parallel.py", line 1061, in __call__
    self.retrieve()
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/site-packages/joblib/parallel.py", line 938, in retrieve
    self._output.extend(job.get(timeout=self.timeout))
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/site-packages/joblib/_parallel_backends.py", line 542, in wrap_future_result
    return future.result(timeout=timeout)
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/concurrent/futures/_base.py", line 435, in result
    return self.__get_result()
  File "/home/zhuct/anaconda3/envs/hypersim-env/lib/python3.7/concurrent/futures/_base.py", line 384, in __get_result
    raise self._exception
AssertionError

I want to know if the problem caused by the parameters setted by _dataset_config.py. And I want to know whether the parameters of each scene should be different, what are these parameters based on, and are there any formulation techniques?The parameters setted for this scene are {"name": "AI61_004", "archive_file": "AI1_001.rar", "asset_file": "01", "normalization_policy": "v0", "scene_extent_meters": 10.0, "voxel_extent_meters": 0.1}.

mikeroberts3000 commented 5 months ago

I have the following thoughts and questions.

Is this the first scene you're attempting to render using our pipeline? Have you successfully worked through our 01_marketplace_dataset example using the same code as you're using here? Presumably if you were encountering problems with Embree, you would have noticed those same problems in other scenes. If you try another scene (e.g., ai_001_001), does this part of the pipeline behave as expected?
When you're debugging this issue, I recommend disabling parallel jobs with the use_single_threaded_reference_implementation flag, and perhaps also disabling the C++ implementation of our algorithm for generating camera trajectories with the use_python_reference_implementation flag. These changes won't solve your problem, but at least they will produce cleaner logs.
The scene-specific parameters that you're setting in _dataset_config.py look reasonable to me, but why is the scene name AI61_004 and the archive file is AI1_001.rar? Is that a funky naming convention in Archinteriors Volume 61 or is that a bug?

To answer your questions, the main reason we need the scene-specific data in _dataset_config.py is because we found it was helpful to provide a bit of extra guidance to our heuristics for estimating the scene's free space and generating camera trajectories. The scene_extent_meters and voxel_extent_meters parameters should be set based on the size of the intended viewing region of the scene, i.e., the size of the region where you'd actually want to place a camera and render images. In general, it is not easy to determine the size of this region automatically because some scenes have large skyboxes and other distant geometry that should not be included in the region. The scene you're working with seems like a roughly average-sized scene, so I think you should be fine with our most common choice of parameters for scene_extent_meters and voxel_extent_meters. When setting these parameters, we used the same values for 90% of our scenes, but we found that we needed to adjust them for very large scenes (e.g., an airport, a shopping mall, etc). That being said, can you check the meters_per_asset_unit value in _detail/metadata_scene.csv for your scene and make sure it matches the scene geometry? For example, if a human-sized chair in your scene is 100 asset units tall, then I would expect a meters_per_asset_unit value of roughly 0.01.

The normalization_policy parameter describes what approach to take when converting old scenes to work with newer versions of V-Ray. For all scenes since Archinteriors Volume 19, we have always used the v0 policy, so I think you should be fine with that too.

Zhuct23 commented 5 months ago

Thank you for your detailed explanation. I have resolved the issue and can now generate the camera trajectory.

mikeroberts3000 commented 5 months ago

That's great! What was the solution? Can you describe it briefly here to help future readers?

Zhuct23 commented 5 months ago

I skipped the frames that could not be generated normally, so maybe I wanted to generate 100 frames, but only 90 frames were generated, but this way no error will be reported.

apple / ml-hypersim

Can't create vaild camera trajectory #68