Closed anmarchenko closed 6 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 99.06%. Comparing base (
f0592d1
) to head (67c63db
).
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
What does this PR do? Adds "unskippable by ITR tests" support for RSpec, Cucumber, and Minitest. It allows application developers using intelligent test runner to mark some of their test to make sure that they are always run and never skipped by ITR.
Motivation ITR is not able to correctly track dependencies between tests and external non-code resources. Also, Ruby code coverage does not work across threads and/or processes.
Examples of tests that should be unskippable by ITR:
Additional Notes Usage examples are below
RSpec:
Cucumber:
Mintiest:
Note that for minitest the developer's experience is not on the same level as for RSpec or Cucumber: this is due to the fact that minitest does not have test tagging capabilities out of the box. Currently it will be required to pass test names of unskippable tests to
datadog_itr_unskippable
method. We'll gather feedback on this and if the need arises, will provide better tagging capabilities (similar to what https://github.com/bernardoamc/minitag or https://github.com/jbodah/minitest-tagz can do).How to test the change? Unit tests are provided.