Closed andrewiggins closed 3 years ago
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 32.09ms - 38.19ms | - | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -10% - +12% -4.10ms - +5.24ms | - |
Version | Avg time | vs other-framework | vs base-framework | vs local-framework | vs fast-framework |
---|---|---|---|---|---|
other-framework | 43.30ms - 52.48ms | - | slower ❌ 19% - 54% 7.24ms - 18.26ms | unsure 🔍 -1% - +26% -0.40ms - +10.72ms | unsure 🔍 -3% - +24% -1.15ms - +10.34ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -22% - -0% -10.72ms - +0.40ms | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -21% - +2% -10.34ms - +1.15ms | - | unsure 🔍 -10% - +12% -4.10ms - +5.24ms |
fast-framework | 32.09ms - 38.19ms | faster ✔ 17% - 36% 7.24ms - 18.26ms | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 32.09ms - 38.19ms | - | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -10% - +12% -4.10ms - +5.24ms | - |
Version | Avg time | vs other-framework | vs base-framework | vs local-framework | vs fast-framework |
---|---|---|---|---|---|
other-framework | 43.30ms - 52.48ms | - | slower ❌ 19% - 54% 7.24ms - 18.26ms | unsure 🔍 -1% - +26% -0.40ms - +10.72ms | unsure 🔍 -3% - +24% -1.15ms - +10.34ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -22% - -0% -10.72ms - +0.40ms | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -21% - +2% -10.34ms - +1.15ms | - | unsure 🔍 -10% - +12% -4.10ms - +5.24ms |
fast-framework | 32.09ms - 38.19ms | faster ✔ 17% - 36% 7.24ms - 18.26ms | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 32.09ms - 38.19ms | - | faster ✔ 8% - 27% 3.22ms - 11.96ms | faster ✔ 9% - 28% 3.55ms - 12.77ms |
base-framework | 39.60ms - 45.87ms | slower ❌ 8% - 35% 3.22ms - 11.96ms | - | unsure 🔍 -12% - +9% -5.24ms - +4.10ms |
local-framework | 39.84ms - 46.76ms | slower ❌ 9% - 38% 3.55ms - 12.77ms | unsure 🔍 -10% - +12% -4.10ms - +5.24ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 137.71ms - 141.73ms | - | faster ✔ 20% - 22% 34.69ms - 39.26ms | faster ✔ 14% - 18% 23.26ms - 31.06ms |
base-framework | 175.60ms - 177.79ms | slower ❌ 24% - 28% 34.69ms - 39.26ms | - | slower ❌ 4% - 8% 6.30ms - 13.34ms |
local-framework | 163.53ms - 170.22ms | slower ❌ 16% - 22% 23.26ms - 31.06ms | faster ✔ 4% - 8% 6.30ms - 13.34ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 2.61ms - 2.61ms | - | faster ✔ 27% - 27% 0.95ms - 0.95ms | faster ✔ 62% - 62% 4.20ms - 4.21ms |
base-framework | 3.56ms - 3.57ms | slower ❌ 36% - 37% 0.95ms - 0.95ms | - | faster ✔ 48% - 48% 3.25ms - 3.26ms |
local-framework | 6.81ms - 6.82ms | slower ❌ 161% - 161% 4.20ms - 4.21ms | slower ❌ 91% - 91% 3.25ms - 3.26ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 3.46ms - 3.70ms | - | faster ✔ 8% - 15% 0.32ms - 0.59ms | slower ❌ 34% - 54% 0.89ms - 1.28ms |
base-framework | 3.98ms - 4.10ms | slower ❌ 9% - 17% 0.32ms - 0.59ms | - | slower ❌ 52% - 72% 1.38ms - 1.71ms |
local-framework | 2.34ms - 2.65ms | faster ✔ 26% - 35% 0.89ms - 1.28ms | faster ✔ 34% - 42% 1.38ms - 1.71ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 1.09ms - 1.09ms | - | slower ❌ 9% - 9% 0.09ms - 0.09ms | slower ❌ 11% - 11% 0.11ms - 0.11ms |
base-framework | 1.00ms - 1.00ms | faster ✔ 8% - 8% 0.09ms - 0.09ms | - | slower ❌ 2% - 2% 0.02ms - 0.02ms |
local-framework | 0.98ms - 0.98ms | faster ✔ 10% - 10% 0.11ms - 0.11ms | faster ✔ 2% - 2% 0.02ms - 0.02ms | - |
tachometer-reporter-action v2 for PR Multi-Measurement Setup Job Flow
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 137.71ms - 141.73ms | - | faster ✔ 20% - 22% 34.69ms - 39.26ms | faster ✔ 14% - 18% 23.26ms - 31.06ms |
base-framework | 175.60ms - 177.79ms | slower ❌ 24% - 28% 34.69ms - 39.26ms | - | slower ❌ 4% - 8% 6.30ms - 13.34ms |
local-framework | 163.53ms - 170.22ms | slower ❌ 16% - 22% 23.26ms - 31.06ms | faster ✔ 4% - 8% 6.30ms - 13.34ms | - |
Version | Avg time | vs fast-framework | vs base-framework | vs local-framework |
---|---|---|---|---|
fast-framework | 2.61ms - 2.61ms | - | faster ✔ 27% - 27% 0.95ms - 0.95ms | faster ✔ 62% - 62% 4.20ms - 4.21ms |
base-framework | 3.56ms - 3.57ms | slower ❌ 36% - 37% 0.95ms - 0.95ms | - | faster ✔ 48% - 48% 3.25ms - 3.26ms |
local-framework | 6.81ms - 6.82ms | slower ❌ 161% - 161% 4.20ms - 4.21ms | slower ❌ 91% - 91% 3.25ms - 3.26ms | - |
Version | Avg time | vs this-change | vs tip-of-tree tip-of-tree | vs previous-release previous-release |
---|---|---|---|---|
this-change | 20.82ms - 22.81ms | - | slower ❌ 12% - 25% 2.30ms - 4.61ms | faster ✔ 37% - 43% 13.48ms - 15.85ms |
tip-of-tree tip-of-tree | 17.78ms - 18.94ms | faster ✔ 11% - 21% 2.30ms - 4.61ms | - | faster ✔ 48% - 51% 17.26ms - 18.98ms |
previous-release previous-release | 35.84ms - 37.12ms | slower ❌ 59% - 75% 13.48ms - 15.85ms | slower ❌ 92% - 106% 17.26ms - 18.98ms | - |
Version | Avg time | vs this-change | vs tip-of-tree tip-of-tree | vs previous-release previous-release |
---|---|---|---|---|
this-change | 55.97ms - 58.17ms | - | slower ❌ 142% - 158% 33.02ms - 35.52ms | faster ✔ 31% - 34% 26.16ms - 29.21ms |
tip-of-tree tip-of-tree | 22.21ms - 23.39ms | faster ✔ 59% - 61% 33.02ms - 35.52ms | - | faster ✔ 72% - 74% 60.75ms - 63.17ms |
previous-release previous-release | 83.70ms - 85.81ms | slower ❌ 45% - 52% 26.16ms - 29.21ms | slower ❌ 261% - 282% 60.75ms - 63.17ms | - |
Version | Avg time | vs this-change | vs tip-of-tree tip-of-tree | vs previous-release previous-release |
---|---|---|---|---|
this-change | 136.50ms - 140.18ms | - | slower ❌ 142% - 159% 80.59ms - 85.64ms | faster ✔ 17% - 20% 28.79ms - 33.70ms |
tip-of-tree tip-of-tree | 53.49ms - 56.95ms | faster ✔ 59% - 61% 80.59ms - 85.64ms | - | faster ✔ 66% - 69% 111.99ms - 116.74ms |
previous-release previous-release | 167.95ms - 171.21ms | slower ❌ 21% - 25% 28.79ms - 33.70ms | slower ❌ 197% - 217% 111.99ms - 116.74ms | - |
tachometer-reporter-action v2 for PR Multi-Measurement Summarize Job Flow
Allow the user to define which measurements from a benchmark should be summarized.
true
means include all measurements in the summary,false
means include none of the measurements, and a string of comma-separated measurement names means only include the names of these measurements in the summary.Closes #32