kpertsch / rlds_dataset_builder

An example RLDS dataset builder for X-embodiment dataset conversion.
MIT License
81 stars 115 forks source link

segmentation fault error #12

Open Rachealthong opened 3 months ago

Rachealthong commented 3 months ago

The segmentation fault error did not occur when I built the example data. However, the segmentation fault kept occurring at 9 examples when I was building my own dataset.

Generating splits...:   0%|                                        Fatal Python error: Segmentation fault                | 0/1 [00:00<?, ? splits/s]
Generating train examples...: 9 examples [16:48, 114.10s/ examples]
Thread 0x00007f416b313700 (most recent call first):
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/threading.py", line 316 in wait
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/threading.py", line 574 in wait
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tqdm/_monitor.py", line 60 in run
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/threading.py", line 950 in _bootstrap_inner
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/threading.py", line 908 in _bootstrap

Current thread 0x00007f4305479740 (most recent call first):
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/example_serializer.py", line 145 in _dict_to_tf_example
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/example_serializer.py", line 83 in get_tf_example
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/example_serializer.py", line 98 in serialize_example
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/writer.py", line 236 in write
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/split_builder.py", line 417 in _build_from_generator
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/split_builder.py", line 341 in submit_split_generation
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/dataset_builder.py", line 1535 in _download_and_prepare
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/dataset_builder.py", line 646 in download_and_prepare
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/core/logging/__init__.py", line 169 in __call__
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/scripts/cli/build.py", line 518 in _download_and_prepare
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/scripts/cli/build.py", line 282 in _build_datasets
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/scripts/cli/main.py", line 104 in main
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/absl/app.py", line 254 in _run_main
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/absl/app.py", line 308 in run
  File "/home/user/anaconda3/envs/rlds_env/lib/python3.9/site-packages/tensorflow_datasets/scripts/cli/main.py", line 109 in launch_cli
  File "/home/user/anaconda3/envs/rlds_env/bin/tfds", line 8 in <module>
Segmentation fault (core dumped)