intel / cve-bin-tool

The CVE Binary Tool helps you determine if your system includes known vulnerabilities. You can scan binaries for over 200 common, vulnerable components (openssl, libpng, libxml2, expat and others), or if you know the components used, you can get a list of known vulnerabilities associated with an SBOM or a list of components and versions.
https://cve-bin-tool.readthedocs.io/en/latest/
GNU General Public License v3.0
1.23k stars 464 forks source link

test: Reduce tests run in short tests jobs #4319

Closed terriko closed 3 months ago

terriko commented 3 months ago

Our short tests are currently not much shorter than our long tests. Since we've seldom seen only one version of python have a problem with a checker, I'm experimenting to see if running the many MANY mapping tests only in the long_tests jobs will help us reduce the time it takes for short tests to run.

I've also added some pytest insrumentation so we can see which of our tests take the longest to run so that we can hopefully find other places to reduce our usage footprint.

terriko commented 3 months ago

Looks like this reduced each short test run by around 10 minutes (or 1/3 of the total run time) so I'm pretty happy with that.