princeton-vl / infinigen

Infinite Photorealistic Worlds using Procedural Generation
https://infinigen.org
BSD 3-Clause "New" or "Revised" License
5.14k stars 430 forks source link

Segmentation fault when running Hello World example #231

Open jalalirs opened 2 months ago

jalalirs commented 2 months ago

Describe the bug

python -m infinigen_examples.generate_nature --seed 0 --task render -g under_water.gin simple.gin --input_folder outputs/under_water/fine --output_folder outputs/under_water/frames /red/peddn8/ssd/usr/jalalirs/code/infinigen/venv/lib/python3.10/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero. setattr(self, word, getattr(machar, word).flat[0]) /red/peddn8/ssd/usr/jalalirs/code/infinigen/venv/lib/python3.10/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero. return self._float_to_str(self.smallest_subnormal) /red/peddn8/ssd/usr/jalalirs/code/infinigen/venv/lib/python3.10/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero. setattr(self, word, getattr(machar, word).flat[0]) /red/peddn8/ssd/usr/jalalirs/code/infinigen/venv/lib/python3.10/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero. return self._float_to_str(self.smallest_subnormal) [12:34:56.452] [root] [WARNING] | SMB_AUTH envvar is not set, smb_client upload will not work. Ignore this message if not using upload [12:34:56.635] [infinigen.core.init] [INFO] | Converted seed='0' to scene_seed=0, parsed as hexadecimal [12:34:56.675] [infinigen.core.execute_tasks] [INFO] | infinigen version 1.2.5 [12:34:56.675] [infinigen.core.execute_tasks] [INFO] | CUDA_VISIBLE_DEVICES=0,1,2,3 [12:34:56.679] [infinigen.times] [INFO] | [MAIN TOTAL] [12:34:56.680] [infinigen.times] [INFO] | [Reading input blendfile] Read blend: "/red/peddn8/ssd/usr/jalalirs/code/infinigen/infinigen_examples/outputs/under_water/fine/scene.blend" [12:35:05.012] [infinigen.times] [INFO] | [Reading input blendfile] finished in 0:00:08.331708 [12:35:05.013] [root] [WARNING] | Re-initialized 277 as trusted. Do not run infinigen on untrusted blend files. [12:35:05.013] [infinigen.core.execute_tasks] [INFO] | Processing frames 1 through 1 inclusive [12:35:05.271] [infinigen.times] [INFO] | [Create terrain] [12:35:05.271] [infinigen.terrain.core] [INFO] | Terrain using only on the fly on_the_fly_asset_folder=PosixPath('/red/peddn8/ssd/usr/jalalirs/code/infinigen/infinigen_examples/outputs/under_water/frames/assets') [12:35:05.770] [infinigen.terrain.core] [INFO] | Terrain elements: ['ground', 'landtiles', 'warped_rocks', 'voronoi_rocks', 'liquid', 'atmosphere'] [12:35:05.770] [infinigen.times] [INFO] | [Create terrain] finished in 0:00:00.499277 [12:35:05.771] [infinigen.times] [INFO] | [Render Frames] [12:35:05.771] [infinigen.times] [INFO] | [Enable GPU] [12:35:06.134] [infinigen.infinigen_gpl.extras.enable_gpu] [INFO] | Device Tesla V100-PCIE-32GB of type OPTIX found and used. [12:35:06.134] [infinigen.times] [INFO] | [Enable GPU] finished in 0:00:00.363660 [12:35:06.134] [infinigen.times] [INFO] | [Render/Cycles settings] [12:35:06.156] [infinigen.times] [INFO] | [Render/Cycles settings] finished in 0:00:00.021340 [12:35:06.156] [infinigen.times] [INFO] | [Compositing Setup] [12:35:06.210] [infinigen.times] [INFO] | [Compositing Setup] finished in 0:00:00.053754 [12:35:06.210] [infinigen.times] [INFO] | [get_camera] [12:35:06.210] [infinigen.times] [INFO] | [get_camera] finished in 0:00:00.000098 [12:35:06.210] [infinigen.times] [INFO] | [Actual rendering] Fra:1 Mem:3727.31M (Peak 3754.64M) | Time:00:01.37 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | OpaqueTerrain_fine Fra:1 Mem:3733.63M (Peak 3754.64M) | Time:00:01.37 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | liquid_fine Fra:1 Mem:3737.97M (Peak 3754.64M) | Time:00:01.37 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | atmosphere_fine Fra:1 Mem:3738.12M (Peak 3754.64M) | Time:00:01.37 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | scatter:BlenderRockFactory(27855) Fra:1 Mem:3872.32M (Peak 3885.25M) | Time:00:01.58 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | scatter:coral Fra:1 Mem:6870.18M (Peak 6905.49M) | Time:00:05.15 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | scatter:coral.001 Fra:1 Mem:7534.60M (Peak 7548.39M) | Time:00:05.55 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | scatter:GenericTreeFactory(60608) Fra:1 Mem:7876.47M (Peak 7880.96M) | Time:00:06.08 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | scatter:seaweed Fra:1 Mem:7957.08M (Peak 7958.36M) | Time:00:06.15 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | scatter:urchin Fra:1 Mem:8042.94M (Peak 8048.28M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(28) Fra:1 Mem:8042.94M (Peak 8048.28M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(162) Fra:1 Mem:8042.95M (Peak 8048.28M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(198) Fra:1 Mem:8050.70M (Peak 8050.70M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(199) Fra:1 Mem:8058.09M (Peak 8058.09M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(219) Fra:1 Mem:8067.92M (Peak 8067.92M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(221) Fra:1 Mem:8067.92M (Peak 8067.92M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(246) Fra:1 Mem:8075.02M (Peak 8075.02M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(247) Fra:1 Mem:8076.07M (Peak 8076.07M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(312) Fra:1 Mem:8076.07M (Peak 8076.07M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(327) Fra:1 Mem:8089.02M (Peak 8089.02M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(425) Fra:1 Mem:8093.04M (Peak 8093.04M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(427) Fra:1 Mem:8094.45M (Peak 8094.45M) | Time:00:06.24 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(495) Fra:1 Mem:8127.87M (Peak 8127.87M) | Time:00:06.25 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(588) Fra:1 Mem:8146.79M (Peak 8146.79M) | Time:00:06.25 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(597) Fra:1 Mem:8146.79M (Peak 8146.79M) | Time:00:06.25 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 1).parts(0, factory=LobsterBodyFactory) Fra:1 Mem:8235.41M (Peak 8235.41M) | Time:00:06.26 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(600) Fra:1 Mem:8249.32M (Peak 8249.32M) | Time:00:06.27 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(665) Fra:1 Mem:8274.51M (Peak 8280.88M) | Time:00:06.27 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(667) Fra:1 Mem:8305.50M (Peak 8307.31M) | Time:00:06.28 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(741) Fra:1 Mem:8328.23M (Peak 8328.23M) | Time:00:06.28 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(754) Fra:1 Mem:8342.40M (Peak 8342.40M) | Time:00:06.28 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | KelpMonocotFactory(543568399).spawn_asset(774) Fra:1 Mem:8361.69M (Peak 8361.69M) | Time:00:06.29 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 0).parts(12, factory=CrustaceanFinFactory Fra:1 Mem:8366.23M (Peak 8366.23M) | Time:00:06.29 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 0).parts(13, factory=CrustaceanFinFactory Fra:1 Mem:8388.50M (Peak 8388.50M) | Time:00:06.29 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 0).parts(14, factory=CrustaceanFinFactory Fra:1 Mem:8430.63M (Peak 8430.63M) | Time:00:06.30 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 0).parts(15, factory=CrustaceanFinFactory Fra:1 Mem:8395.68M (Peak 8433.48M) | Time:00:06.30 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 0).parts(16, factory=CrustaceanFinFactory Fra:1 Mem:8451.46M (Peak 8451.46M) | Time:00:06.31 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 0).parts(17, factory=CrustaceanEyeFactory Fra:1 Mem:8452.91M (Peak 8452.91M) | Time:00:06.31 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 0).parts(18, factory=CrustaceanEyeFactory Fra:1 Mem:8453.18M (Peak 8453.18M) | Time:00:06.31 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 0).parts(0, factory=LobsterBodyFactory) Fra:1 Mem:8477.29M (Peak 8477.29M) | Time:00:06.32 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 1).parts(12, factory=CrustaceanFinFactory Fra:1 Mem:8472.56M (Peak 8477.29M) | Time:00:06.32 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 1).parts(13, factory=CrustaceanFinFactory Fra:1 Mem:8696.05M (Peak 8696.88M) | Time:00:06.35 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 1).parts(14, factory=CrustaceanFinFactory Fra:1 Mem:8707.23M (Peak 8707.23M) | Time:00:06.37 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 1).parts(15, factory=CrustaceanFinFactory Fra:1 Mem:8724.71M (Peak 8724.71M) | Time:00:06.37 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 1).parts(16, factory=CrustaceanFinFactory Fra:1 Mem:8742.62M (Peak 8757.98M) | Time:00:06.38 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 1).parts(17, factory=CrustaceanEyeFactory Fra:1 Mem:8809.61M (Peak 8809.61M) | Time:00:06.40 | Mem:0.00M, Peak:0.00M | Scene, ViewLayer | Synchronizing object | crustacean(543568399, 1).parts(18, factory=CrustaceanEyeFactory Segmentation fault (core dumped)

Steps to Reproduce

I am trying to produce the under_water scene using the hello world guide. It fails at the third command

What version of the code were you using?

commit 18be26c9b4a7b375442d23569b737d8e2169e372

What command did you run?

python -m infinigen_examples.generate_nature --seed 0 --task coarse -g under_water.gin simple.gin --output_folder outputs/under_water/coarse python -m infinigen_examples.generate_nature --seed 0 --task populate fine_terrain -g under_water.gin simple.gin --input_folder outputs/hello_world/coarse --output_folder outputs/under_water/fine python -m infinigen_examples.generate_nature --seed 0 --task render -g under_water.gin simple.gin --input_folder outputs/under_water/fine --output_folder outputs/hello_world/frames

Platform

Additional context

During installation I had to comment out the following line in install_opengl.sh. While the compilation completes without any issue if you run the script manually, when it runs through pip and the through the make file it fails after the compilation is completed and the folder is exited causing the whole installation to fail

./build/customgt -in x -out x --frame 0
if [ $? -eq 174 ]; then
    echo "OpenGL/EGL ground truth is working."
else
    echo "WARNING: OpenGL/EGL is not supported on this machine. If you are running from a cluster head-node, this is likely not an issue."
fi
cd -