pulumi / ci-mgmt

Configuration for all things CI
Apache License 2.0
9 stars 4 forks source link

Gate CI with provider init benchmarks #695

Open t0yv0 opened 10 months ago

t0yv0 commented 10 months ago

Add a Go Benchmark to measure how long it takes to initialize a Provider(). Calibrate and add a baseline number in CI. Add a test that asserts the benchmark does not go over the baseline.

We certainly know this can be a problem for bridged providers, due to ProviderInfo processing, so prioritize those first. If this is also a problem for native providers can consider doing it there.

Native Providers

Bridged Providers

Tier 1

Tier 2

mjeffryes commented 10 months ago

related: [Epic] Add performance tests to tier 1 providers· home/3159