apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
https://kyuubi.apache.org/
Apache License 2.0
2.08k stars 908 forks source link

[TASK][EASY] Fix flaky test BatchesV2ResourceSuite #5526

Open yaooqinn opened 11 months ago

yaooqinn commented 11 months ago

Code of Conduct

Search before creating

Mentor

Skill requirements

Background and Goals

BatchesV2ResourceSuite:
- open batch session
- open batch session with uploading resource *** FAILED ***
  The code passed to eventually never returned normally. Attempted 35 times over 5.016062152 seconds. Last failure message: Array(/home/runner/work/kyuubi/kyuubi/kyuubi-server/target/work/upload/spark-examples_2.12-3.1.3-20231025183320-3.jar) was not empty. (BatchesResourceSuite.scala:308)

Implementation steps

Additional context

No response

weixi62961 commented 11 months ago

@yaooqinn Could you please assign it to me? suppose to complete it on 29th October cc @bowenliang123

weixi62961 commented 11 months ago

Let's update the status of the task, any advice is welcome. @yaooqinn @bowenliang123

It seems that the test case was failed randomly in CI.

  1. It was passed in my local machine.
  2. It was passed in CI run, e.g. run 6624136416
  3. But it was failed in CI run, e.g. run 6623039619

screenshot-20231028-120727

yaooqinn commented 11 months ago

Hi @weixi62961 yes, it's randomly failures, so we call it flaky test

davidyuan1223 commented 10 months ago

Let's update the status of the task, any advice is welcome. @yaooqinn @bowenliang123

It seems that the test case was failed randomly in CI.

  1. It was passed in my local machine.
  2. It was passed in CI run, e.g. run 6624136416
  3. But it was failed in CI run, e.g. run 6623039619

screenshot-20231028-120727

for this issue, it's mean there have a random failures, we need find the random failure reasons, there are some suggest

  1. some configuration may make the test case failed
  2. try to debug and analysis why the example-xxx.jar not empty, the main reason may is the delete not complete image there are samilar issue #5600 , wish it can help you