BMCV / galaxy-image-analysis

Galaxy tools for image analysis
MIT License
14 stars 14 forks source link

minimal example of ray-core 2.3.0 issue #63

Closed kostrykin closed 10 months ago

kostrykin commented 1 year ago

FOR CONTRIBUTOR:


This PR is a minimal example of the issues with ray-core 2.3.0 discussed here.

Testing locally using planemo test fails with the following traceback:

Traceback (most recent call last):
  File "~/Documents/galaxy-image-analysis/tools/ray/test-ray.py", line 14, in <module>
    ray.put(img)
  File "~/miniconda3/envs/mulled-v1-39f3d1847eed69f0dc3016fa006eadc25f1a113b0ec5fae72d4fd19e33b963ae/lib/python3.10/site-packages/ray/_private/client_mode_hook.py", line 105, in wrapper
    return func(*args, **kwargs)
  File "~/miniconda3/envs/mulled-v1-39f3d1847eed69f0dc3016fa006eadc25f1a113b0ec5fae72d4fd19e33b963ae/lib/python3.10/site-packages/ray/_private/worker.py", line 2452, in put
    object_ref = worker.put_object(value, owner_address=serialize_owner_address)
  File "~/miniconda3/envs/mulled-v1-39f3d1847eed69f0dc3016fa006eadc25f1a113b0ec5fae72d4fd19e33b963ae/lib/python3.10/site-packages/ray/_private/worker.py", line 621, in put_object
    self.core_worker.put_serialized_object_and_increment_local_ref(
  File "python/ray/_raylet.pyx", line 1780, in ray._raylet.CoreWorker.put_serialized_object_and_increment_local_ref
  File "python/ray/_raylet.pyx", line 1669, in ray._raylet.CoreWorker._create_put_buffer
  File "python/ray/_raylet.pyx", line 209, in ray._raylet.check_status
ray.exceptions.RaySystemError: System error: Broken pipe
.

The test passes if the code is reduced any further.

kostrykin commented 1 year ago

Maybe this is after all unrelated to Galaxy: https://github.com/ray-project/ray/issues/37197