google-research / kubric

A data generation pipeline for creating semi-realistic synthetic multi-object videos with rich annotations such as instance segmentation masks, depth maps, and optical flow.
Apache License 2.0
2.28k stars 226 forks source link

MOVi test script error #216

Open CYHSM opened 2 years ago

CYHSM commented 2 years ago

Hey there, thanks for this amazing repository. I was trying to run the MOVi challenge scripts and get an error. I used

docker run --rm --interactive \
  --user $(id -u):$(id -g)    \
  --volume "$(pwd):/kubric"   \
  kubricdockerhub/kubruntu    \
  /usr/bin/python3 challenges/movi/movi_c_worker.py \
  --camera=fixed_random

and get the following output:

docker run --rm --interactive   --user $(id -u):$(id -g)      --volume "$(pwd):/kubric"     kubricdockerhub/kubruntu      /usr/bin/python3 challenges/movi/movi_c_worker.py   --camera=fixed_random
INFO:kubric.utils:{ 'backgrounds_split': 'train',
  'camera': 'fixed_random',
  'floor_friction': 0.3,
  'floor_restitution': 0.5,
  'frame_end': 24,
  'frame_rate': 12,
  'frame_start': 1,
  'gso_assets': 'gs://kubric-public/assets/GSO/GSO.json',
  'hdri_assets': 'gs://kubric-public/assets/HDRI_haven/HDRI_haven.json',
  'job_dir': 'output',
  'kubasic_assets': 'gs://kubric-public/assets/KuBasic/KuBasic.json',
  'logging_level': 'INFO',
  'max_camera_movement': 4.0,
  'max_num_objects': 10,
  'min_num_objects': 3,
  'objects_split': 'train',
  'resolution': 256,
  'save_state': False,
  'scratch_dir': '/tmp/tmpmgejva9d',
  'seed': None,
  'step_rate': 240}
INFO:root:Deleting content of old scratch-dir: /tmp/tmpmgejva9d
INFO:root:Using scratch directory: /tmp/tmpmgejva9d
INFO:root:Using output directory: output
Starting Script
Traceback (most recent call last):
  File "/kubric/challenges/movi/movi_c_worker.py", line 78, in <module>
    kubasic = kb.AssetSource.from_manifest(FLAGS.kubasic_assets)
  File "/usr/local/lib/python3.9/dist-packages/kubric/assets/asset_source.py", line 74, in from_manifest
    manifest = file_io.read_json(manifest_path)
  File "/usr/local/lib/python3.9/dist-packages/kubric/file_io.py", line 83, in read_json
    return json.load(fp, )
  File "/usr/lib/python3.9/json/__init__.py", line 293, in load
    return loads(fp.read(),
  File "/usr/local/lib/python3.9/dist-packages/tensorflow/python/lib/io/file_io.py", line 116, in read
    length = self.size() - self.tell()
  File "/usr/local/lib/python3.9/dist-packages/tensorflow/python/lib/io/file_io.py", line 95, in size
    return stat(self.__name).length
  File "/usr/local/lib/python3.9/dist-packages/tensorflow/python/lib/io/file_io.py", line 906, in stat
    return stat_v2(filename)
  File "/usr/local/lib/python3.9/dist-packages/tensorflow/python/lib/io/file_io.py", line 922, in stat_v2
    return _pywrap_file_io.Stat(compat.path_to_str(path))
tensorflow.python.framework.errors_impl.AbortedError: All 10 retry attempts failed. The last failure: Error executing an HTTP request: libcurl code 42 meaning 'Operation was aborted by an application callback', error details: Callback aborted
     when reading metadata of gs://kubric-public/assets/KuBasic/KuBasic.json
Error: Not freed memory blocks: 1, total unfreed memory 0.001259 MB

Any idea where this can come from? Thanks a lot.

DarlingHang commented 2 years ago

Similar issue when dealing with robust NeRF

Qwlouse commented 2 years ago

Hmm weird. That looks like you cannot access gs://kubric-public/assets/KuBasic/KuBasic.json for some reason. Can you verify that you have internet access from your container?

docker run --rm --interactive \
  --user $(id -u):$(id -g)    \
  kubricdockerhub/kubruntu \
  curl https://storage.googleapis.com/kubric-public/assets/KuBasic/KuBasic.json