search

ray-project / ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
33.99k stars 5.78k forks source link

CI test linux://python/ray/data:test_huggingface is consistently_failing #44516

Closed can-anyscale closed 1 month ago

can-anyscale commented 7 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 7 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/3886#018eb183-2e04-472b-99ea-b2a688032ba2

can-anyscale commented 7 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 7 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/3888#018eb45a-a7ca-44b3-9624-54f50bc13f53

can-anyscale commented 7 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 7 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 7 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/3890#018eb527-8611-4531-aaad-1af4d916bb65

can-anyscale commented 7 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 7 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/3891#018eb723-8d04-4691-b7b3-47ca973fdefe

can-anyscale commented 7 months ago

CI test linux://python/ray/data:test_huggingface is flaky. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 7 months ago

CI test linux://python/ray/data:test_huggingface is flaky. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 7 months ago

This test is now flaky likely because of a server side regressions of hugging face, so might not be a release blocker. I remove the weekly-release-blocker tag to generate a candidate green build for now. We'll make a final decision next week.

can-anyscale commented 7 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/3944#018ec9ea-0465-4c22-909f-e3d65969e306

can-anyscale commented 6 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 6 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/4112#018f061b-2f64-453f-8b4e-bed7e26b6369

can-anyscale commented 6 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 6 months ago

This test is now considered as flaky because it has been failing on postmerge for too long. Flaky tests do not run on premerge.

can-anyscale commented 6 months ago

hugging face is good now

can-anyscale commented 6 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/4162#018f125f-68ca-44e9-a52e-baa2cfbdc84b

can-anyscale commented 4 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 4 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/5038#01903766-9317-4e45-968e-338cb5027f19

can-anyscale commented 4 months ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 4 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/5038#019037f7-973d-406d-89ca-f390135c9d5a

can-anyscale commented 4 months ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/5038#019037f7-973d-406d-89ca-f390135c9d5a

can-anyscale commented 1 month ago

CI test linux://python/ray/data:test_huggingface is consistently_failing. Recent failures:

DataCaseName-linux://python/ray/data:test_huggingface-END Managed by OSS Test Policy

can-anyscale commented 1 month ago

This test is now considered as flaky because it has been failing on postmerge for too long. Flaky tests do not run on premerge.

can-anyscale commented 1 month ago

Blamed commit: aca67b30243978e02832be4575efb5c5caaf47ae found by bisect job https://buildkite.com/ray-project/release-tests-bisect/builds/1624

can-anyscale commented 1 month ago

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/6552#019290f9-d246-4c2d-af4a-2b05fec11377