search

callstack / reassure

Performance testing companion for React and React Native
https://callstack.github.io/reassure/
MIT License
1.21k stars 25 forks source link

refactor: future support for returning multiple results #464

Closed mdjastrzebski closed 4 months ago

mdjastrzebski commented 4 months ago

Summary

Make public API more flexible in supporting multiple results per measure* call.

Test plan

changeset-bot[bot] commented 4 months ago

🦋 Changeset detected

Latest commit: 9a7643c284ee32e2dffcfc6738cdc76fda253147

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 6 packages | Name | Type | | --------------------------- | ----- | | @callstack/reassure-measure | Minor | | reassure | Minor | | @callstack/reassure-cli | Minor | | @callstack/reassure-compare | Minor | | @callstack/reassure-danger | Minor | | @callstack/reassure-logger | Minor |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

github-actions[bot] commented 4 months ago

Performance Comparison Report

Significant Changes To Duration

Name Type Duration Count
fib 30 function 89.1 ms → 84.7 ms (-4.4 ms, -4.9%) 1 → 1
Show details | Name | Type | Duration | Count | | ------ | -------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------- | | fib 30 | function | **Baseline**
Mean: 89.1 ms
Stdev: 0.2 ms (0.2%)
Runs: 89.4 89.4 89.2 89.2 89.2 89.1 89.0 89.0 89.0 88.8

**Current**
Mean: 84.7 ms
Stdev: 0.8 ms (1.0%)
Runs: 86.6 85.5 85.4 84.7 84.4 84.3 84.3 84.1 84.0 84.0 | **Baseline**
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1

**Current**
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 |

Meaningless Changes To Duration

Show entries | Name | Type | Duration | Count | | ---------------------------------- | -------- | ------------------------------------- | ------ | | Async Component | render | 197.8 ms → 201.8 ms (+4.0 ms, +2.0%) | 7 → 7 | | fib 31 | function | 153.5 ms → 149.8 ms (-3.8 ms, -2.5%) | 1 → 1 | | fib 32 | function | 242.8 ms → 242.1 ms (-0.8 ms, ±0.0%) | 1 → 1 | | Other Component 10 | render | 119.2 ms → 118.9 ms (-0.3 ms, ±0.0%) | 4 → 4 | | Other Component 10 legacy scenario | render | 116.8 ms → 120.1 ms (+3.3 ms, +2.8%) | 4 → 4 | | Other Component 20 | render | 120.5 ms → 121.4 ms (+0.9 ms, +0.7%) | 4 → 4 |
Show details | Name | Type | Duration | Count | | ---------------------------------- | -------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Async Component | render | **Baseline**
Mean: 197.8 ms
Stdev: 5.7 ms (2.9%)
Runs: 210 201 200 200 198 198 195 194 193 189

**Current**
Mean: 201.8 ms
Stdev: 5.8 ms (2.9%)
Runs: 214 206 205 203 202 200 200 198 197 193 | **Baseline**
Mean: 7
Stdev: 0 (0.0%)
Runs: 7 7 7 7 7 7 7 7 7 7

**Current**
Mean: 7
Stdev: 0 (0.0%)
Runs: 7 7 7 7 7 7 7 7 7 7 | | fib 31 | function | **Baseline**
Mean: 153.5 ms
Stdev: 0.9 ms (0.6%)
Runs: 156.0 153.5 153.4 153.4 153.4 153.4 153.3 153.2 153.2 152.7

**Current**
Mean: 149.8 ms
Stdev: 1.8 ms (1.2%)
Runs: 151.1 151.1 150.9 150.6 149.9 149.9 149.8 149.8 149.7 144.7 | **Baseline**
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1

**Current**
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 | | fib 32 | function | **Baseline**
Mean: 242.8 ms
Stdev: 1.8 ms (0.8%)
Runs: 246.6 245.9 242.3 242.2 242.1 242.1 242.1 241.9 241.6 241.6

**Current**
Mean: 242.1 ms
Stdev: 1.0 ms (0.4%)
Runs: 243.6 243.0 242.9 242.7 242.4 242.2 241.1 240.9 240.9 240.9 | **Baseline**
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1

**Current**
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 | | Other Component 10 | render | **Baseline**
Mean: 119.2 ms
Stdev: 3.8 ms (3.2%)
Runs: 124 123 122 121 119 119 119 118 116 111

**Current**
Mean: 118.9 ms
Stdev: 4.2 ms (3.5%)
Runs: 125 123 122 120 120 119 118 117 114 111 | **Baseline**
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4

**Current**
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 | | Other Component 10 legacy scenario | render | **Baseline**
Mean: 116.8 ms
Stdev: 4.5 ms (3.8%)
Runs: 127 119 119 118 117 116 114 114 113 111

**Current**
Mean: 120.1 ms
Stdev: 4.4 ms (3.7%)
Runs: 128 125 124 121 120 119 117 117 116 114 | **Baseline**
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4

**Current**
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 | | Other Component 20 | render | **Baseline**
Mean: 120.5 ms
Stdev: 6.9 ms (5.8%)
Runs: 138 130 130 129 123 123 123 121 120 120 119 119 118 116 116 114 114 113 113 111

**Current**
Mean: 121.4 ms
Stdev: 4.2 ms (3.4%)
Runs: 129 127 126 126 125 123 123 123 123 122 122 121 121 120 118 117 116 116 116 114 | **Baseline**
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

**Current**
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 |

Changes To Count

There are no entries

Added Scenarios

There are no entries

Removed Scenarios

There are no entries

Generated by :no_entry_sign: dangerJS against 9a7643c284ee32e2dffcfc6738cdc76fda253147