WIP chore(ci_visibility): collect module-level line execution and imports

[romainkomorndatadog]

NOTE: still very much a WIP

This explores changes necessary for coverage collection for the Intelligent Test Runner in order to be able to properly capture import-time dependencies on other modules.

To achieve this, the following are introduced:

• optional instrumentation of import statements to capture that a given file imported a given module
• optional capture of execution of module-level lines during coverage collection
• optional reporting of import-time covered lines for modules traversed during regular coverage

The pytest usage of the internal coverage library is updated to use the collection of import-time lines, resulting in expanded coverage for all tests (or suites if using suite-level skipping).

Checklist

• [ ] Change(s) are motivated and described in the PR description
• [ ] Testing strategy is described if automated tests are not included in the PR
• [ ] Risks are described (performance impact, potential for breakage, maintainability)
• [ ] Change is maintainable (easy to change, telemetry, documentation)
• [ ] Library release note guidelines are followed or label changelog/no-changelog is set
• [ ] Documentation is included (in-code, generated user docs, public corp docs)
• [ ] Backport labels are set (if applicable)
• [ ] If this PR changes the public interface, I've notified @DataDog/apm-tees.

Reviewer Checklist

• [ ] Title is accurate
• [ ] All changes are related to the pull request's stated goal
• [ ] Description motivates each change
• [ ] Avoids breaking API changes
• [ ] Testing strategy adequately addresses listed risks
• [ ] Change is maintainable (easy to change, telemetry, documentation)
• [ ] Release note makes sense to a user of the library
• [ ] Author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• [ ] Backport labels are set in a manner that is consistent with the release branch maintenance policy

[datadog-dd-trace-py-rkomorn[bot]]

Datadog Report

Branch report: romain.komorn/CIVIS-9428/add_session_coverage Commit report: 0b535b8 Test service: dd-trace-py

:x: 35 Failed (0 Known Flaky), 175423 Passed, 1139 Skipped, 11h 27m 18.3s Total duration (27m 59.73s time saved)

:x: Failed Tests (35)

This report shows up to 5 failed tests.

• test_cmdi - test_pygoat.py - Details

<details>
<summary>Expand for error</summary>

```
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
```
</details>

• test_cmdi - test_pygoat.py - Details

  Expand for error

  ``` ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) ```

• test_cmdi - test_pygoat.py

• test_cmdi - test_pygoat.py - Details

  Expand for error

  ``` ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) ```

• test_cmdi - test_pygoat.py - Details

  Expand for error

  ``` ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) ```

[pr-commenter[bot]]

Benchmarks

Benchmark execution time: 2024-06-27 14:53:05

Comparing candidate commit 42240d9a59bb4f885c99afca82dcbff4770d06e3 in PR branch romain.komorn/CIVIS-9428/add_session_coverage with baseline commit 83f8e3c8b7d0181bb10fa930670c84048acd0a3e in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 205 metrics, 9 unstable metrics.