secure-systems-lab / securesystemslib

Cryptographic and general-purpose routines for Secure Systems Lab projects at NYU
MIT License
48 stars 49 forks source link

Fine-tune code coverage measurement for optional builds #208

Open lukpueh opened 4 years ago

lukpueh commented 4 years ago

Description of issue or feature request: @joshuagl has recently overhauled sslib's extra dependency handling. This included the configuration of different tests for different sets of installed dependencies (see #200 and #206.)

In the course of a code review we discussed the possibility of different coverage profiles that accurately report the tested lines depending on the relevant code branches. See https://github.com/secure-systems-lab/securesystemslib/pull/200#discussion_r368568724 ff. for some ideas.

Current behavior: Code branches that are executed due to missing optional dependency are generally excluded from code coverage.

Expected behavior: Accurately report the tested lines depending on the relevant code branches for a given build.

lukpueh commented 1 year ago

Also consider code branches being skipped on certain platform, e.g. PySPX on Windows (#518)

lukpueh commented 1 year ago

Also consider code branches being skipped on certain platform, e.g. PySPX on Windows (#518)

... and HSM on Windows (#542)