search

ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
32.95k stars 5.58k forks source link

[Release process] Doc tests are neglected #36521

Open ArturNiederfahrenhorst opened 1 year ago

ArturNiederfahrenhorst commented 1 year ago

Description

Our Doc tests (":book: Documentation") become red quite often. There is often not enough sense of ownership for the teams who own the failing tests. This is likely caused by a combination of the following:

  1. The test is often red, so not a reliable signal that your PR causes an issue
  2. The logs are very large and hard to parse
  3. The test is shared between all teams

Just as a reminder which jobtest is referenced here, it's this one:

Screenshot 2023-06-16 at 15 32 50

Link

No response

hora-anyscale commented 1 year ago

@maxpumperla @angelinalg - thoughts on how to improve the process for doc release tests?