ordo-one / package-benchmark

Swift benchmark runner with many performance metrics and great CI support
Apache License 2.0
326 stars 25 forks source link

feat: Adding support for benchmark init command #135

Closed hassila closed 1 year ago

hassila commented 1 year ago

Description

Fixes #129

Adds swift package benchmark init <target> supporting creation of boilerplate + adding target to Package.swift.

How Has This Been Tested?

Manual testing.

Minimal checklist:

github-actions[bot] commented 1 year ago

Pull request benchmark comparison [ubuntu-latest] with 'main' run at 2023-03-28T16:22:27+00:00 Pull request had performance regressions

codecov[bot] commented 1 year ago

Codecov Report

Merging #135 (3ac8c87) into main (12a3b7f) will not change coverage. The diff coverage is 68.75%.

:exclamation: Current head 3ac8c87 differs from pull request most recent head 9971a0a. Consider uploading reports for the commit 9971a0a to get more accurate results

Additional details and impacted files [![Impacted file tree graph](https://codecov.io/gh/ordo-one/package-benchmark/pull/135/graphs/tree.svg?width=650&height=150&src=pr&token=hXHmhEG1iF&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one)](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) ```diff @@ Coverage Diff @@ ## main #135 +/- ## ======================================= Coverage 78.53% 78.53% ======================================= Files 23 23 Lines 2641 2641 ======================================= Hits 2074 2074 Misses 567 567 ``` | [Impacted Files](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) | Coverage Δ | | |---|---|---| | [Sources/Benchmark/ARCStats/ARCStatsProducer.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQVJDU3RhdHMvQVJDU3RhdHNQcm9kdWNlci5zd2lmdA==) | `66.67% <0.00%> (ø)` | | | [...ark/MallocStats/MallocStatsProducer+jemalloc.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvTWFsbG9jU3RhdHMvTWFsbG9jU3RhdHNQcm9kdWNlcitqZW1hbGxvYy5zd2lmdA==) | `59.81% <ø> (ø)` | | | [Sources/Benchmark/Benchmark.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrLnN3aWZ0) | `70.45% <87.50%> (ø)` | | | [Sources/Benchmark/BenchmarkExecutor.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrRXhlY3V0b3Iuc3dpZnQ=) | `93.73% <100.00%> (ø)` | | | [Impacted Files](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) | Coverage Δ | | |---|---|---| | [Sources/Benchmark/ARCStats/ARCStatsProducer.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQVJDU3RhdHMvQVJDU3RhdHNQcm9kdWNlci5zd2lmdA==) | `66.67% <0.00%> (ø)` | | | [...ark/MallocStats/MallocStatsProducer+jemalloc.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvTWFsbG9jU3RhdHMvTWFsbG9jU3RhdHNQcm9kdWNlcitqZW1hbGxvYy5zd2lmdA==) | `59.81% <ø> (ø)` | | | [Sources/Benchmark/Benchmark.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrLnN3aWZ0) | `70.45% <87.50%> (ø)` | | | [Sources/Benchmark/BenchmarkExecutor.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrRXhlY3V0b3Iuc3dpZnQ=) | `93.73% <100.00%> (ø)` | | ------ [Continue to review full report in Codecov by Sentry](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one). Last update [12a3b7f...9971a0a](https://codecov.io/gh/ordo-one/package-benchmark/pull/135?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one).
github-actions[bot] commented 1 year ago

:tada: This PR is included in version 1.4.0 :tada:

The release is available on GitHub release

Your semantic-release bot :package::rocket: