ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
33.31k stars 5.63k forks source link

Release test rllib_learning_tests_pong_ppo_torch.aws failed #45713

Closed can-anyscale closed 1 month ago

can-anyscale commented 4 months ago

Release test rllib_learning_tests_pong_ppo_torch.aws failed. See https://buildkite.com/ray-project/release/builds/16725#018fe1f2-a6ac-4002-b08b-6d5c34f87e40 for more details.

Managed by OSS Test Policy

can-anyscale commented 4 months ago

Blamed commit: 32cddaecac648fe663c2fef2e7ea8f24e03b234c found by bisect job https://buildkite.com/ray-project/release-tests-bisect/builds/1202

sven1977 commented 4 months ago

Removed release blocker and P0. Experiment reached +19.7 reward (instead of 20.0). Will relax the pass criterion for this test a bit ...

can-anyscale commented 4 months ago

Test has been failing for far too long. Jailing.

sven1977 commented 1 month ago

Unjailing for now. Test does seem to run fine on current master branch.

can-anyscale commented 1 month ago

Test passed on latest run: https://buildkite.com/ray-project/release/builds/21202#019159b4-b83e-4e4d-844b-c83c10762cd0