rapidsai / cuxfilter

GPU accelerated cross filtering with cuDF.
https://docs.rapids.ai/api/cuxfilter/stable/
Apache License 2.0
272 stars 66 forks source link

[BUG] Flaky Test #592

Open AjayThorve opened 3 months ago

AjayThorve commented 3 months ago

During the CI process, we have identified a flaky test within the cuxfilter/tests/test_dashboard.py module. The test, TestDashBoard::test_variables, intermittently fails with an AssertionError, expecting an empty dictionary but instead receiving {'col_1_chart': '6<=col_1<=9'}. The behavior is inconsistent, with the test passing on most occasions but occasionally failing, as detailed in the CI run 8650157417.

                                               16     16     0%
2024-04-11T16:46:30.6701268Z -------------------------------------------------------------------------------------------
2024-04-11T16:46:30.6702366Z TOTAL                                                                    3774   2797    26%
2024-04-11T16:46:30.6703800Z Coverage XML written to file /__w/cuxfilter/cuxfilter/coverage-results/cuxfilter-coverage.xml
2024-04-11T16:46:30.6704750Z 
2024-04-11T16:46:30.6705125Z =========================== short test summary info ============================
2024-04-11T16:46:30.6729393Z FAILED cuxfilter/tests/test_dashboard.py::TestDashBoard::test_variables - AssertionError: assert {'col_1_chart': '6<=col_1<=9'} == {}
2024-04-11T16:46:30.6730854Z   
2024-04-11T16:46:30.6731281Z   Left contains 1 more item:
2024-04-11T16:46:30.6731972Z   {'col_1_chart': '6<=col_1<=9'}
2024-04-11T16:46:30.6732546Z   
2024-04-11T16:46:30.6732953Z   Full diff:
2024-04-11T16:46:30.6733424Z   - {}
2024-04-11T16:46:30.6733817Z   + {
2024-04-11T16:46:30.6734330Z   +     'col_1_chart': '6<=col_1<=9',
2024-04-11T16:46:30.6734940Z   + }
2024-04-11T16:46:30.6735703Z ============ 1 failed, 155 passed, 53 warnings in 98.68s (0:01:38) =============
2024-04-11T16:46:31.2803345Z /__w/cuxfilter/cuxfilter
2024-04-11T16:46:31.2900363Z