[SUPPORT] CI Test Environment Issue Blocking Multiple PRs

[usberkeley]

Describe the problem you faced

Hello team, we're experiencing an issue with the CI Test environment, which is blocking multiple PRs, not just mine. To illustrate the problem, I downloaded the origin/master branch, made a minor change by adding a period, and it still failed in the GitHub CI Test. Another piece of evidence indicating an issue with the GitHub CI Test is that the test function which fails there runs perfectly fine locally.

To Reproduce

Steps to reproduce the behavior:

1. download origin/master
2. made a minor change by adding a period
3. Submit PR
4. Failed in the GitHub CI Test

Refer to the following PR：

12274

Expected behavior

CI Test Successful

Environment Description

• Hudi version : master

• Spark version : none

• Hive version : none

• Hadoop version : none

• Storage (HDFS/S3/GCS..) : none

• Running on Docker? (yes/no) : no

Stacktrace

Error:  Errors: 
Error:    TestStructuredStreaming.$anonfun$structuredStreamingForTestClusteringRunner$1:407->waitTillAtleastNCommits:224 » NoSuchElement
[INFO] 
Error:  Tests run: 709, Failures: 0, Errors: 1, Skipped: 1

[danny0405]

yes, because we merge quite a few large PRs these days for the rolling migration story between 0.x and 1.x Hudi, would take some time to dig into the details for these failures.

[usberkeley]

yes, because we merge quite a few large PRs these days for the rolling migration story between 0.x and 1.x Hudi, would take some time to dig into the details for these failures.

Sure, understood, thanks