search

felixdivo / ros2-easy-test

A Python test framework for ROS2 allowing simple and expressive assertions based on message interactions.
https://ros2-easy-test.readthedocs.io
MIT License
15 stars 5 forks source link

Debug test cases on `rolling` #48

Open felixdivo opened 2 months ago

felixdivo commented 2 months ago

Quite frequently, the test suite fails on rolling. This might well be a race condition that is present everywhere and only surfaces in rolling.

FAILED ros2_easy_test/tests/test_interactions.py::TestSingleNode::test_multiple_messages_stress_test - AssertionError: Only 161 messages out of 1000 expected ones were published on topic /mouth after a total timeout of 55.0 seconds
FAILED ros2_easy_test/tests/demo/hypothesis_test.py::test_on_same_node - hypothesis.errors.Flaky: Inconsistent results from replaying a test case!
  last: INTERESTING from AssertionError at /__w/ros2-easy-test/ros2-easy-test/ros2_easy_test/ros2_easy_test/env.py:191
    context: Empty at /__w/ros2-easy-test/ros2-easy-test/ros2_easy_test/ros2_easy_test/env.py:189
  this: INTERESTING from AssertionError at /__w/ros2-easy-test/ros2-easy-test/ros2_easy_test/tests/demo/hypothesis_test.py:43