feat: Eliminating use of @dynamicReplacement, auto generate boilerplate, update required dependencies

hassila commented 1 year ago

Description

Cleaning up API for stable release:

Add boilerplate generation plugin to remove boilerplate needed for benchmark suite definitions
Change benchmark boilerplate to a simple 'let benchmarks = { }'
Change target name from BenchmarkSupport -> Benchmark for external users
Need to change dependency to have both Benchmark and BenchmarkPlugin for external users

Fixes #110

How Has This Been Tested?

Manual and test suite

Minimal checklist:

[x] I have performed a self-review of my own code
[x] I have added DocC code-level documentation for any public interfaces exported by the package
[x] I have added unit and/or integration tests that prove my fix is effective or that my feature works

github-actions[bot] commented 1 year ago

Pull request benchmark comparison [ubuntu-latest] with 'main' run at 2023-03-20T08:38:49+00:00 Pull request had performance regressions

github-actions[bot] commented 1 year ago

Benchmark check for [ubuntu-latest] comparing with 'main' run at 2023-03-17T11:40:09+00:00 Pull request had performance regressions

codecov[bot] commented 1 year ago

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@2a86a2a). Click here to learn what that means. The diff coverage is 23.81%.

Additional details and impacted files

[![Impacted file tree graph](https://codecov.io/gh/ordo-one/package-benchmark/pull/111/graphs/tree.svg?width=650&height=150&src=pr&token=hXHmhEG1iF&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one)](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) ```diff @@ Coverage Diff @@ ## main #111 +/- ## ======================================= Coverage ? 77.63% ======================================= Files ? 20 Lines ? 2392 Branches ? 0 ======================================= Hits ? 1857 Misses ? 535 Partials ? 0 ``` | [Impacted Files](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) | Coverage Δ | | |---|---|---| | [...urces/Benchmark/BenchmarkExecutor+Extensions.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrRXhlY3V0b3IrRXh0ZW5zaW9ucy5zd2lmdA==) | `67.31% <ø> (ø)` | | | [Sources/Benchmark/BenchmarkExecutor.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrRXhlY3V0b3Iuc3dpZnQ=) | `97.39% <ø> (ø)` | | | [Sources/Benchmark/BenchmarkRunner+ReadWrite.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrUnVubmVyK1JlYWRXcml0ZS5zd2lmdA==) | `0.00% <ø> (ø)` | | | [Sources/Benchmark/BenchmarkRunner.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrUnVubmVyLnN3aWZ0) | `56.25% <0.00%> (ø)` | | | [...ark/MallocStats/MallocStatsProducer+jemalloc.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvTWFsbG9jU3RhdHMvTWFsbG9jU3RhdHNQcm9kdWNlcitqZW1hbGxvYy5zd2lmdA==) | `59.81% <ø> (ø)` | | | [Sources/Benchmark/NIOLock.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvTklPTG9jay5zd2lmdA==) | `74.19% <ø> (ø)` | | | [...stemStats/OperatingSystemStatsProducer+Linux.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvT3BlcmF0aW5nU3lzdGVtU3RhdHMvT3BlcmF0aW5nU3lzdGVtU3RhdHNQcm9kdWNlcitMaW51eC5zd2lmdA==) | `94.81% <ø> (ø)` | | | [Sources/BenchmarkSupport/Benchmark.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmtTdXBwb3J0L0JlbmNobWFyay5zd2lmdA==) | `71.32% <ø> (ø)` | | | [...es/BenchmarkSupport/BenchmarkMetric+Defaults.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmtTdXBwb3J0L0JlbmNobWFya01ldHJpYytEZWZhdWx0cy5zd2lmdA==) | `46.97% <ø> (ø)` | | | [Sources/BenchmarkSupport/BenchmarkMetric.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmtTdXBwb3J0L0JlbmNobWFya01ldHJpYy5zd2lmdA==) | `71.50% <ø> (ø)` | | | ... and [7 more](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) | | | [Impacted Files](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) | Coverage Δ | | |---|---|---| | [...urces/Benchmark/BenchmarkExecutor+Extensions.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrRXhlY3V0b3IrRXh0ZW5zaW9ucy5zd2lmdA==) | `67.31% <ø> (ø)` | | | [Sources/Benchmark/BenchmarkExecutor.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrRXhlY3V0b3Iuc3dpZnQ=) | `97.39% <ø> (ø)` | | | [Sources/Benchmark/BenchmarkRunner+ReadWrite.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrUnVubmVyK1JlYWRXcml0ZS5zd2lmdA==) | `0.00% <ø> (ø)` | | | [Sources/Benchmark/BenchmarkRunner.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvQmVuY2htYXJrUnVubmVyLnN3aWZ0) | `56.25% <0.00%> (ø)` | | | [...ark/MallocStats/MallocStatsProducer+jemalloc.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvTWFsbG9jU3RhdHMvTWFsbG9jU3RhdHNQcm9kdWNlcitqZW1hbGxvYy5zd2lmdA==) | `59.81% <ø> (ø)` | | | [Sources/Benchmark/NIOLock.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvTklPTG9jay5zd2lmdA==) | `74.19% <ø> (ø)` | | | [...stemStats/OperatingSystemStatsProducer+Linux.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmsvT3BlcmF0aW5nU3lzdGVtU3RhdHMvT3BlcmF0aW5nU3lzdGVtU3RhdHNQcm9kdWNlcitMaW51eC5zd2lmdA==) | `94.81% <ø> (ø)` | | | [Sources/BenchmarkSupport/Benchmark.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmtTdXBwb3J0L0JlbmNobWFyay5zd2lmdA==) | `71.32% <ø> (ø)` | | | [...es/BenchmarkSupport/BenchmarkMetric+Defaults.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmtTdXBwb3J0L0JlbmNobWFya01ldHJpYytEZWZhdWx0cy5zd2lmdA==) | `46.97% <ø> (ø)` | | | [Sources/BenchmarkSupport/BenchmarkMetric.swift](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one#diff-U291cmNlcy9CZW5jaG1hcmtTdXBwb3J0L0JlbmNobWFya01ldHJpYy5zd2lmdA==) | `71.50% <ø> (ø)` | | | ... and [7 more](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) | | ------ [Continue to review full report in Codecov by Sentry](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one). Last update [2a86a2a...c1545f6](https://codecov.io/gh/ordo-one/package-benchmark/pull/111?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ordo-one).

ordo-one / package-benchmark