Open andrewiggins opened 3 years ago
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 32.09ms - 38.19ms | - | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -10% - +12% -4.10ms - +5.24ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 32.09ms - 38.19ms | - | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -10% - +12% -4.10ms - +5.24ms | - |
Version | Avg time | vs other-framework | vs base-framework | vs local-framework | vs fast-framework |
---|---|---|---|---|---|
other-framework | 43.30ms - 52.48ms | - | slower ❌ 19% - 54% 7.24ms - 18.26ms | unsure 🔍 -1% - +26% -0.40ms - +10.72ms | unsure 🔍 -3% - +24% -1.15ms - +10.34ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -22% - -0% -10.72ms - +0.40ms | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -21% - +2% -10.34ms - +1.15ms | - | unsure 🔍 -10% - +12% -4.10ms - +5.24ms |
fast-framework | 32.09ms - 38.19ms | faster ✔ 17% - 36% 7.24ms - 18.26ms | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 137.71ms - 141.73ms | - | faster ✔ 20% - 22% 34.69ms - 39.26ms | faster ✔ 14% - 18% 23.26ms - 31.06ms |
base-framework | 175.60ms - 177.79ms | slower ❌ 24% - 28% 34.69ms - 39.26ms | - | slower ❌ 4% - 8% 6.30ms - 13.34ms |
local-framework | 163.53ms - 170.22ms | slower ❌ 16% - 22% 23.26ms - 31.06ms | faster ✔ 4% - 8% 6.30ms - 13.34ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 2.61ms - 2.61ms | - | faster ✔ 27% - 27% 0.95ms - 0.95ms | faster ✔ 62% - 62% 4.20ms - 4.21ms |
base-framework | 3.56ms - 3.57ms | slower ❌ 36% - 37% 0.95ms - 0.95ms | - | faster ✔ 48% - 48% 3.25ms - 3.26ms |
local-framework | 6.81ms - 6.82ms | slower ❌ 161% - 161% 4.20ms - 4.21ms | slower ❌ 91% - 91% 3.25ms - 3.26ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 3.46ms - 3.70ms | - | faster ✔ 8% - 15% 0.32ms - 0.59ms | slower ❌ 34% - 54% 0.89ms - 1.28ms |
base-framework | 3.98ms - 4.10ms | slower ❌ 9% - 17% 0.32ms - 0.59ms | - | slower ❌ 52% - 72% 1.38ms - 1.71ms |
local-framework | 2.34ms - 2.65ms | faster ✔ 26% - 35% 0.89ms - 1.28ms | faster ✔ 34% - 42% 1.38ms - 1.71ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 1.09ms - 1.09ms | - | slower ❌ 9% - 9% 0.09ms - 0.09ms | slower ❌ 11% - 11% 0.11ms - 0.11ms |
base-framework | 1.00ms - 1.00ms | faster ✔ 8% - 8% 0.09ms - 0.09ms | - | slower ❌ 2% - 2% 0.02ms - 0.02ms |
local-framework | 0.98ms - 0.98ms | faster ✔ 10% - 10% 0.11ms - 0.11ms | faster ✔ 2% - 2% 0.02ms - 0.02ms | - |
tachometer-reporter-action v2 for PR Multi-Measurement Setup Job Flow
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 137.71ms - 141.73ms | - | faster ✔ 20% - 22% 34.69ms - 39.26ms | faster ✔ 14% - 18% 23.26ms - 31.06ms |
base-framework | 175.60ms - 177.79ms | slower ❌ 24% - 28% 34.69ms - 39.26ms | - | slower ❌ 4% - 8% 6.30ms - 13.34ms |
local-framework | 163.53ms - 170.22ms | slower ❌ 16% - 22% 23.26ms - 31.06ms | faster ✔ 4% - 8% 6.30ms - 13.34ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 2.61ms - 2.61ms | - | faster ✔ 27% - 27% 0.95ms - 0.95ms | faster ✔ 62% - 62% 4.20ms - 4.21ms |
base-framework | 3.56ms - 3.57ms | slower ❌ 36% - 37% 0.95ms - 0.95ms | - | faster ✔ 48% - 48% 3.25ms - 3.26ms |
local-framework | 6.81ms - 6.82ms | slower ❌ 161% - 161% 4.20ms - 4.21ms | slower ❌ 91% - 91% 3.25ms - 3.26ms | - |
Version | Avg time | vs this-change | vs tip-of-tree tip-of-tree | vs previous-release previous-release |
---|---|---|---|---|
this-change | 20.82ms - 22.81ms | - | slower ❌ 12% - 25% 2.30ms - 4.61ms | faster ✔ 37% - 43% 13.48ms - 15.85ms |
tip-of-tree tip-of-tree | 17.78ms - 18.94ms | faster ✔ 11% - 21% 2.30ms - 4.61ms | - | faster ✔ 48% - 51% 17.26ms - 18.98ms |
previous-release previous-release | 35.84ms - 37.12ms | slower ❌ 59% - 75% 13.48ms - 15.85ms | slower ❌ 92% - 106% 17.26ms - 18.98ms | - |
Version | Avg time | vs this-change | vs tip-of-tree tip-of-tree | vs previous-release previous-release |
---|---|---|---|---|
this-change | 55.97ms - 58.17ms | - | slower ❌ 142% - 158% 33.02ms - 35.52ms | faster ✔ 31% - 34% 26.16ms - 29.21ms |
tip-of-tree tip-of-tree | 22.21ms - 23.39ms | faster ✔ 59% - 61% 33.02ms - 35.52ms | - | faster ✔ 72% - 74% 60.75ms - 63.17ms |
previous-release previous-release | 83.70ms - 85.81ms | slower ❌ 45% - 52% 26.16ms - 29.21ms | slower ❌ 261% - 282% 60.75ms - 63.17ms | - |
Version | Avg time | vs this-change | vs tip-of-tree tip-of-tree | vs previous-release previous-release |
---|---|---|---|---|
this-change | 136.50ms - 140.18ms | - | slower ❌ 142% - 159% 80.59ms - 85.64ms | faster ✔ 17% - 20% 28.79ms - 33.70ms |
tip-of-tree tip-of-tree | 53.49ms - 56.95ms | faster ✔ 59% - 61% 80.59ms - 85.64ms | - | faster ✔ 66% - 69% 111.99ms - 116.74ms |
previous-release previous-release | 167.95ms - 171.21ms | slower ❌ 21% - 25% 28.79ms - 33.70ms | slower ❌ 197% - 217% 111.99ms - 116.74ms | - |
tachometer-reporter-action v2 for PR Multi-Measurement Summarize Job Flow
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 32.09ms - 38.19ms | - | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -10% - +12% -4.10ms - +5.24ms | - |
Version | Avg time | vs other-framework | vs base-framework | vs local-framework | vs fast-framework |
---|---|---|---|---|---|
other-framework | 43.30ms - 52.48ms | - | slower ❌ 19% - 54% 7.24ms - 18.26ms | unsure 🔍 -1% - +26% -0.40ms - +10.72ms | unsure 🔍 -3% - +24% -1.15ms - +10.34ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -22% - -0% -10.72ms - +0.40ms | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -21% - +2% -10.34ms - +1.15ms | - | unsure 🔍 -10% - +12% -4.10ms - +5.24ms |
fast-framework | 32.09ms - 38.19ms | faster ✔ 17% - 36% 7.24ms - 18.26ms | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 137.71ms - 141.73ms | - | faster ✔ 20% - 22% 34.69ms - 39.26ms | faster ✔ 14% - 18% 23.26ms - 31.06ms |
base-framework | 175.60ms - 177.79ms | slower ❌ 24% - 28% 34.69ms - 39.26ms | - | slower ❌ 4% - 8% 6.30ms - 13.34ms |
local-framework | 163.53ms - 170.22ms | slower ❌ 16% - 22% 23.26ms - 31.06ms | faster ✔ 4% - 8% 6.30ms - 13.34ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 2.61ms - 2.61ms | - | faster ✔ 27% - 27% 0.95ms - 0.95ms | faster ✔ 62% - 62% 4.20ms - 4.21ms |
base-framework | 3.56ms - 3.57ms | slower ❌ 36% - 37% 0.95ms - 0.95ms | - | faster ✔ 48% - 48% 3.25ms - 3.26ms |
local-framework | 6.81ms - 6.82ms | slower ❌ 161% - 161% 4.20ms - 4.21ms | slower ❌ 91% - 91% 3.25ms - 3.26ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 3.46ms - 3.70ms | - | faster ✔ 8% - 15% 0.32ms - 0.59ms | slower ❌ 34% - 54% 0.89ms - 1.28ms |
base-framework | 3.98ms - 4.10ms | slower ❌ 9% - 17% 0.32ms - 0.59ms | - | slower ❌ 52% - 72% 1.38ms - 1.71ms |
local-framework | 2.34ms - 2.65ms | faster ✔ 26% - 35% 0.89ms - 1.28ms | faster ✔ 34% - 42% 1.38ms - 1.71ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 1.09ms - 1.09ms | - | slower ❌ 9% - 9% 0.09ms - 0.09ms | slower ❌ 11% - 11% 0.11ms - 0.11ms |
base-framework | 1.00ms - 1.00ms | faster ✔ 8% - 8% 0.09ms - 0.09ms | - | slower ❌ 2% - 2% 0.02ms - 0.02ms |
local-framework | 0.98ms - 0.98ms | faster ✔ 10% - 10% 0.11ms - 0.11ms | faster ✔ 2% - 2% 0.02ms - 0.02ms | - |
tachometer-reporter-action v2 for PR Artifacts For Forks Flow
📊 Tachometer Benchmark Results
Summary
duration
base-framework vs fast-framework Customize summary
base-framework vs fast-framework Customize summary
window.usedJSHeapSize
base-framework vs fast-framework Customize summary
base-framework vs fast-framework Customize summary
Results
test_bench
duration
20% - 22%
34.69ms - 39.26ms
14% - 18%
23.26ms - 31.06ms
24% - 28%
34.69ms - 39.26ms
4% - 8%
6.30ms - 13.34ms
16% - 22%
23.26ms - 31.06ms
4% - 8%
6.30ms - 13.34ms
window.usedJSHeapSize
27% - 27%
0.95ms - 0.95ms
62% - 62%
4.20ms - 4.21ms
36% - 37%
0.95ms - 0.95ms
48% - 48%
3.25ms - 3.26ms
161% - 161%
4.20ms - 4.21ms
91% - 91%
3.25ms - 3.26ms
test_bench_2
duration
8% - 15%
0.32ms - 0.59ms
34% - 54%
0.89ms - 1.28ms
9% - 17%
0.32ms - 0.59ms
52% - 72%
1.38ms - 1.71ms
26% - 35%
0.89ms - 1.28ms
34% - 42%
1.38ms - 1.71ms
window.usedJSHeapSize
9% - 9%
0.09ms - 0.09ms
11% - 11%
0.11ms - 0.11ms
8% - 8%
0.09ms - 0.09ms
2% - 2%
0.02ms - 0.02ms
10% - 10%
0.11ms - 0.11ms
2% - 2%
0.02ms - 0.02ms
tachometer-reporter-action v2 for PR Artifacts Multi-Measurement Setup Job Flow