search

XQP-Munich / LDPC4QKD

Rate adaptive LDPC based solutions for distributed source coding
GNU General Public License v3.0
21 stars 10 forks source link

Automatic benchmarks and plots #11

Closed XQP-Munich closed 1 year ago

XQP-Munich commented 2 years ago

This PR will introduce automatized running of the benchmarks and generation of plots showing the results.

codecov-commenter commented 2 years ago

Codecov Report

Patch coverage: 31.46% and project coverage change: -8.03 :warning:

Comparison is base (53afef5) 54.50% compared to head (c8ea622) 46.47%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #11 +/- ## ========================================== - Coverage 54.50% 46.47% -8.03% ========================================== Files 8 11 +3 Lines 655 936 +281 Branches 348 559 +211 ========================================== + Hits 357 435 +78 - Misses 45 82 +37 - Partials 253 419 +166 ``` | [Impacted Files](https://app.codecov.io/gh/XQP-Munich/LDPC4QKD/pull/11?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None) | Coverage Δ | | |---|---|---| | [...marks\_error\_rate/main\_critical\_rate\_simulation.cpp](https://app.codecov.io/gh/XQP-Munich/LDPC4QKD/pull/11?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-YmVuY2htYXJrc19lcnJvcl9yYXRlL21haW5fY3JpdGljYWxfcmF0ZV9zaW11bGF0aW9uLmNwcA==) | `32.05% <0.00%> (ø)` | | | [benchmarks\_error\_rate/main\_rate\_adapted\_fer.cpp](https://app.codecov.io/gh/XQP-Munich/LDPC4QKD/pull/11?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-YmVuY2htYXJrc19lcnJvcl9yYXRlL21haW5fcmF0ZV9hZGFwdGVkX2Zlci5jcHA=) | `19.75% <0.00%> (ø)` | | | [src/read\_ldpc\_file\_formats.hpp](https://app.codecov.io/gh/XQP-Munich/LDPC4QKD/pull/11?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c3JjL3JlYWRfbGRwY19maWxlX2Zvcm1hdHMuaHBw) | `35.21% <0.00%> (ø)` | | | [benchmarks\_error\_rate/code\_simulation\_helpers.hpp](https://app.codecov.io/gh/XQP-Munich/LDPC4QKD/pull/11?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-YmVuY2htYXJrc19lcnJvcl9yYXRlL2NvZGVfc2ltdWxhdGlvbl9oZWxwZXJzLmhwcA==) | `29.09% <29.09%> (ø)` | | | [tests/test\_read\_ldpc\_from\_files.cpp](https://app.codecov.io/gh/XQP-Munich/LDPC4QKD/pull/11?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-dGVzdHMvdGVzdF9yZWFkX2xkcGNfZnJvbV9maWxlcy5jcHA=) | `45.83% <45.83%> (ø)` | | | [src/encoder.hpp](https://app.codecov.io/gh/XQP-Munich/LDPC4QKD/pull/11?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c3JjL2VuY29kZXIuaHBw) | `75.60% <100.00%> (ø)` | | ... and [3 files with indirect coverage changes](https://app.codecov.io/gh/XQP-Munich/LDPC4QKD/pull/11/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

XQP-Munich commented 2 years ago

The changes thus far were merged into main. The task of automating the benchmarks was not addressed there. It will be addressed in this PR.

XQP-Munich commented 1 year ago

The automatic benchmarks and plots are still NOT IMPLEMENTED.

Nevertheless, the following has been done with warrants merging