konveyor / tackle-test-generator-core

Apache License 2.0
28 stars 21 forks source link

Test case instrumentation for measuring interaction coverage #110

Open rachelt44 opened 2 years ago

rachelt44 commented 2 years ago

Is your feature request related to a problem? Please describe.

We want to measure interaction coverage of a given test suite (e.g., dev-written tests) in order to exclude that coverage from the space of all n-way type interactions that the ctd-amplified test suite is targeting.

Describe the solution you'd like

Dynamically analyzing the types passed via method interfaces using source-level instrumentation seems the easiest way to achieve this goal. Per method under test, once the passed types are figured out, we can give this type combinations set as an input test suite to ACTS, and generate a test suite in extend mode that augments an existing test suite to reach 100% interaction coverage. The test plan that the modeler creates for test generation will include only the additional combinations that ACTS generated.

Describe alternatives you've considered

A clear and concise description of any alternative solutions or features you've considered.

Additional context

Add any other context or screenshots about the feature request here.