search

VowpalWabbit / reinforcement_learning

Interaction-side integration library for Reinforcement Learning loops: Predict, Log, [Learn,] Update
MIT License
75 stars 40 forks source link

Flaky unit test(s) #606

Open peterychang opened 9 months ago

peterychang commented 9 months ago

Seen in CI, the unit test queue_config_drop_rate_test failed once, passed on rerun.

The error message is

2024-02-07T19:32:02.5486140Z     Start 1: rltest
2024-02-07T19:33:00.8003827Z 1/1 Test #1: rltest ...........................***Failed   58.25 sec
2024-02-07T19:33:00.8004700Z Running 225 test cases...
2024-02-07T19:33:00.8007301Z D:/a/reinforcement_learning/reinforcement_learning/unit_test/async_batcher_test.cc(388): error: in "queue_config_drop_rate_test": check items[0] == "0.00\n0.69\n0.70\n" has failed [0.00
2024-02-07T19:33:00.8008886Z  != 0.00
2024-02-07T19:33:00.8009202Z 0.69
2024-02-07T19:33:00.8009494Z 0.70
2024-02-07T19:33:00.8009773Z ]

I presume more of the async batcher tests will have similar issues