PolyJIT / benchbuild

Empirical-Research Toolkit
MIT License
11 stars 12 forks source link

feat(source): introduce type skeleton and prototypes for context-awar… #510

Closed simbuerg closed 2 years ago

simbuerg commented 2 years ago

…e version enumeration.

This introduces a (currently) non-working stage of context-aware version enumeration.

The main idea will be a 2-phase design for version enumeration:

The resulting list of variant context objects will be iterated on by benchbuild just as before.

Integration for CLI is pending. In essence, all sampling and filtering should be possible on the new enumeration just as before.

codecov[bot] commented 2 years ago

Codecov Report

Base: 50.74% // Head: 52.23% // Increases project coverage by +1.49% :tada:

Coverage data is based on head (6702cc1) compared to base (cd65176). Patch coverage: 59.48% of modified lines in pull request are covered.

:exclamation: Current head 6702cc1 differs from pull request most recent head ca716b1. Consider uploading reports for the commit ca716b1 to get more accurate results

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #510 +/- ## ========================================== + Coverage 50.74% 52.23% +1.49% ========================================== Files 124 124 Lines 8207 8304 +97 Branches 1274 1025 -249 ========================================== + Hits 4165 4338 +173 + Misses 3882 3789 -93 - Partials 160 177 +17 ``` | [Impacted Files](https://codecov.io/gh/PolyJIT/benchbuild/pull/510?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT) | Coverage Δ | | |---|---|---| | [benchbuild/cli/project.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC9jbGkvcHJvamVjdC5weQ==) | `53.57% <0.00%> (-1.31%)` | :arrow_down: | | [benchbuild/projects/gentoo/portage\_gen.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC9wcm9qZWN0cy9nZW50b28vcG9ydGFnZV9nZW4ucHk=) | `25.58% <ø> (ø)` | | | [benchbuild/utils/actions.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC91dGlscy9hY3Rpb25zLnB5) | `54.50% <ø> (-1.21%)` | :arrow_down: | | [benchbuild/utils/db.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC91dGlscy9kYi5weQ==) | `60.63% <25.00%> (ø)` | | | [benchbuild/project.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC9wcm9qZWN0LnB5) | `57.95% <41.02%> (-2.05%)` | :arrow_down: | | [benchbuild/source/versions.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC9zb3VyY2UvdmVyc2lvbnMucHk=) | `62.50% <50.00%> (-4.17%)` | :arrow_down: | | [benchbuild/source/base.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC9zb3VyY2UvYmFzZS5weQ==) | `70.10% <57.30%> (-12.04%)` | :arrow_down: | | [benchbuild/projects/test/test.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC9wcm9qZWN0cy90ZXN0L3Rlc3QucHk=) | `60.19% <64.17%> (+6.34%)` | :arrow_up: | | [benchbuild/experiment.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC9leHBlcmltZW50LnB5) | `81.90% <75.00%> (ø)` | | | [benchbuild/environments/entrypoints/cli.py](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT#diff-YmVuY2hidWlsZC9lbnZpcm9ubWVudHMvZW50cnlwb2ludHMvY2xpLnB5) | `85.52% <100.00%> (+1.31%)` | :arrow_up: | | ... and [17 more](https://codecov.io/gh/PolyJIT/benchbuild/pull/510/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT) | | Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT). Have a feature suggestion? [Share it here.](https://app.codecov.io/gh/feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=PolyJIT)

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.