search

andrewiggins / tachometer-reporter-action

Report the results of Polymer/tachometer in a comment for PRs
MIT License
20 stars 4 forks source link

Add example workflow_run workflow #38

Closed andrewiggins closed 3 years ago

github-actions[bot] commented 3 years ago

📊 Tachometer Benchmark Results

Summary

  • test_bench: unsure 🔍 -10% - +12% (-4.10ms - +5.24ms)
    local-framework vs base-framework
  • test_bench_2: slower ❌ 8% - 35% (3.22ms - 11.96ms)
    base-framework vs other-framework Customize summary

Results

test_bench
VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework32.09ms - 38.19ms-faster ✔
8% - 27%
3.22ms - 11.96ms		faster ✔
9% - 28%
3.55ms - 12.77ms
base-framework39.60ms - 45.87msslower ❌
8% - 35%
3.22ms - 11.96ms		-unsure 🔍
-12% - +9%
-5.24ms - +4.10ms
local-framework39.84ms - 46.76msslower ❌
9% - 38%
3.55ms - 12.77ms		unsure 🔍
-10% - +12%
-4.10ms - +5.24ms		-
test_bench_2
VersionAvg timevs other-frameworkvs base-frameworkvs local-frameworkvs fast-framework
other-framework43.30ms - 52.48ms-slower ❌
19% - 54%
7.24ms - 18.26ms		unsure 🔍
-1% - +26%
-0.40ms - +10.72ms		unsure 🔍
-3% - +24%
-1.15ms - +10.34ms
base-framework39.60ms - 45.87msslower ❌
8% - 35%
3.22ms - 11.96ms		-unsure 🔍
-22% - -0%
-10.72ms - +0.40ms		unsure 🔍
-12% - +9%
-5.24ms - +4.10ms
local-framework39.84ms - 46.76msslower ❌
9% - 38%
3.55ms - 12.77ms		unsure 🔍
-21% - +2%
-10.34ms - +1.15ms		-unsure 🔍
-10% - +12%
-4.10ms - +5.24ms
fast-framework32.09ms - 38.19msfaster ✔
17% - 36%
7.24ms - 18.26ms		faster ✔
8% - 27%
3.22ms - 11.96ms		faster ✔
9% - 28%
3.55ms - 12.77ms		-

tachometer-reporter-action v2 for PR Multi Init Flow

github-actions[bot] commented 3 years ago

📊 Tachometer Benchmark Results

Summary

  • test-bench-1: unsure 🔍 -10% - +12% (-4.10ms - +5.24ms)
    local-framework vs base-framework
  • ⏱ test-bench-2: slower ❌ 8% - 35% (3.22ms - 11.96ms)
    base-framework vs other-framework Customize summary

Results

test-bench-1
VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework32.09ms - 38.19ms-faster ✔
8% - 27%
3.22ms - 11.96ms		faster ✔
9% - 28%
3.55ms - 12.77ms
base-framework39.60ms - 45.87msslower ❌
8% - 35%
3.22ms - 11.96ms		-unsure 🔍
-12% - +9%
-5.24ms - +4.10ms
local-framework39.84ms - 46.76msslower ❌
9% - 38%
3.55ms - 12.77ms		unsure 🔍
-10% - +12%
-4.10ms - +5.24ms		-
⏱ test-bench-2
VersionAvg timevs other-frameworkvs base-frameworkvs local-frameworkvs fast-framework
other-framework43.30ms - 52.48ms-slower ❌
19% - 54%
7.24ms - 18.26ms		unsure 🔍
-1% - +26%
-0.40ms - +10.72ms		unsure 🔍
-3% - +24%
-1.15ms - +10.34ms
base-framework39.60ms - 45.87msslower ❌
8% - 35%
3.22ms - 11.96ms		-unsure 🔍
-22% - -0%
-10.72ms - +0.40ms		unsure 🔍
-12% - +9%
-5.24ms - +4.10ms
local-framework39.84ms - 46.76msslower ❌
9% - 38%
3.55ms - 12.77ms		unsure 🔍
-21% - +2%
-10.34ms - +1.15ms		-unsure 🔍
-10% - +12%
-4.10ms - +5.24ms
fast-framework32.09ms - 38.19msfaster ✔
17% - 36%
7.24ms - 18.26ms		faster ✔
8% - 27%
3.22ms - 11.96ms		faster ✔
9% - 28%
3.55ms - 12.77ms		-

tachometer-reporter-action v2 for PR Setup Job Flow

github-actions[bot] commented 3 years ago

📊 Tachometer Benchmark Results

Summary

duration

  • multi-bench-1: faster ✔ 4% - 8% (6.30ms - 13.34ms)
    local-framework vs base-framework
  • multi-bench-2: slower ❌ 9% - 17% (0.32ms - 0.59ms)
    base-framework vs fast-framework Customize summary

window.usedJSHeapSize

  • multi-bench-1: slower ❌ 91% - 91% (3.25ms - 3.26ms)
    local-framework vs base-framework
  • multi-bench-2: faster ✔ 8% - 8% (0.09ms - 0.09ms)
    base-framework vs fast-framework Customize summary

Results

multi-bench-1

duration

VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework137.71ms - 141.73ms-faster ✔
20% - 22%
34.69ms - 39.26ms		faster ✔
14% - 18%
23.26ms - 31.06ms
base-framework175.60ms - 177.79msslower ❌
24% - 28%
34.69ms - 39.26ms		-slower ❌
4% - 8%
6.30ms - 13.34ms
local-framework163.53ms - 170.22msslower ❌
16% - 22%
23.26ms - 31.06ms		faster ✔
4% - 8%
6.30ms - 13.34ms		-

window.usedJSHeapSize

VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework2.61ms - 2.61ms-faster ✔
27% - 27%
0.95ms - 0.95ms		faster ✔
62% - 62%
4.20ms - 4.21ms
base-framework3.56ms - 3.57msslower ❌
36% - 37%
0.95ms - 0.95ms		-faster ✔
48% - 48%
3.25ms - 3.26ms
local-framework6.81ms - 6.82msslower ❌
161% - 161%
4.20ms - 4.21ms		slower ❌
91% - 91%
3.25ms - 3.26ms		-
multi-bench-2

duration

VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework3.46ms - 3.70ms-faster ✔
8% - 15%
0.32ms - 0.59ms		slower ❌
34% - 54%
0.89ms - 1.28ms
base-framework3.98ms - 4.10msslower ❌
9% - 17%
0.32ms - 0.59ms		-slower ❌
52% - 72%
1.38ms - 1.71ms
local-framework2.34ms - 2.65msfaster ✔
26% - 35%
0.89ms - 1.28ms		faster ✔
34% - 42%
1.38ms - 1.71ms		-

window.usedJSHeapSize

VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework1.09ms - 1.09ms-slower ❌
9% - 9%
0.09ms - 0.09ms		slower ❌
11% - 11%
0.11ms - 0.11ms
base-framework1.00ms - 1.00msfaster ✔
8% - 8%
0.09ms - 0.09ms		-slower ❌
2% - 2%
0.02ms - 0.02ms
local-framework0.98ms - 0.98msfaster ✔
10% - 10%
0.11ms - 0.11ms		faster ✔
2% - 2%
0.02ms - 0.02ms		-

tachometer-reporter-action v2 for PR Multi-Measurement Setup Job Flow

github-actions[bot] commented 3 years ago

📊 Tachometer Benchmark Results

Summary

duration

  • multi-bench-1: faster ✔ 4% - 8% (6.30ms - 13.34ms)
    local-framework vs base-framework

render

  • multi-measure-names: slower ❌ 12% - 25% (2.30ms - 4.61ms)
    this-change vs tip-of-tree

update

  • multi-measure-names: slower ❌ 142% - 158% (33.02ms - 35.52ms)
    this-change vs tip-of-tree

Results

multi-bench-1

duration

VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework137.71ms - 141.73ms-faster ✔
20% - 22%
34.69ms - 39.26ms		faster ✔
14% - 18%
23.26ms - 31.06ms
base-framework175.60ms - 177.79msslower ❌
24% - 28%
34.69ms - 39.26ms		-slower ❌
4% - 8%
6.30ms - 13.34ms
local-framework163.53ms - 170.22msslower ❌
16% - 22%
23.26ms - 31.06ms		faster ✔
4% - 8%
6.30ms - 13.34ms		-

window.usedJSHeapSize

VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework2.61ms - 2.61ms-faster ✔
27% - 27%
0.95ms - 0.95ms		faster ✔
62% - 62%
4.20ms - 4.21ms
base-framework3.56ms - 3.57msslower ❌
36% - 37%
0.95ms - 0.95ms		-faster ✔
48% - 48%
3.25ms - 3.26ms
local-framework6.81ms - 6.82msslower ❌
161% - 161%
4.20ms - 4.21ms		slower ❌
91% - 91%
3.25ms - 3.26ms		-
multi-measure-names

render

VersionAvg timevs this-change
vs tip-of-tree
tip-of-tree		vs previous-release
previous-release
this-change
20.82ms - 22.81ms-slower ❌
12% - 25%
2.30ms - 4.61ms		faster ✔
37% - 43%
13.48ms - 15.85ms
tip-of-tree
tip-of-tree		17.78ms - 18.94msfaster ✔
11% - 21%
2.30ms - 4.61ms		-faster ✔
48% - 51%
17.26ms - 18.98ms
previous-release
previous-release		35.84ms - 37.12msslower ❌
59% - 75%
13.48ms - 15.85ms		slower ❌
92% - 106%
17.26ms - 18.98ms		-

update

VersionAvg timevs this-change
vs tip-of-tree
tip-of-tree		vs previous-release
previous-release
this-change
55.97ms - 58.17ms-slower ❌
142% - 158%
33.02ms - 35.52ms		faster ✔
31% - 34%
26.16ms - 29.21ms
tip-of-tree
tip-of-tree		22.21ms - 23.39msfaster ✔
59% - 61%
33.02ms - 35.52ms		-faster ✔
72% - 74%
60.75ms - 63.17ms
previous-release
previous-release		83.70ms - 85.81msslower ❌
45% - 52%
26.16ms - 29.21ms		slower ❌
261% - 282%
60.75ms - 63.17ms		-

nop-update

VersionAvg timevs this-change
vs tip-of-tree
tip-of-tree		vs previous-release
previous-release
this-change
136.50ms - 140.18ms-slower ❌
142% - 159%
80.59ms - 85.64ms		faster ✔
17% - 20%
28.79ms - 33.70ms
tip-of-tree
tip-of-tree		53.49ms - 56.95msfaster ✔
59% - 61%
80.59ms - 85.64ms		-faster ✔
66% - 69%
111.99ms - 116.74ms
previous-release
previous-release		167.95ms - 171.21msslower ❌
21% - 25%
28.79ms - 33.70ms		slower ❌
197% - 217%
111.99ms - 116.74ms		-

tachometer-reporter-action v2 for PR Multi-Measurement Summarize Job Flow

tachometer-reporter-action v2 for PR Multi-Measurement Summarize Job Flow

github-actions[bot] commented 3 years ago

📊 Tachometer Benchmark Results

Summary

  • test_bench: unsure 🔍 -10% - +12% (-4.10ms - +5.24ms)
    local-framework vs base-framework

Results

test_bench
  • Browser: chrome-headless 83.0.4103.116
  • Sample size: 60
  • Built by: PR Single Job #70
  • Commit: b6ce5fa
VersionAvg timevs fast-frameworkvs base-frameworkvs local-framework
fast-framework32.09ms - 38.19ms-faster ✔
8% - 27%
3.22ms - 11.96ms		faster ✔
9% - 28%
3.55ms - 12.77ms
base-framework39.60ms - 45.87msslower ❌
8% - 35%
3.22ms - 11.96ms		-unsure 🔍
-12% - +9%
-5.24ms - +4.10ms
local-framework39.84ms - 46.76msslower ❌
9% - 38%
3.55ms - 12.77ms		unsure 🔍
-10% - +12%
-4.10ms - +5.24ms		-

tachometer-reporter-action v2 for PR Single Job

andrewiggins commented 3 years ago

Doesn't seem to be running in this PR. Gonna commit to master and see if it runs on new PRs

andrewiggins commented 3 years ago

I messed up the PR comments. Gonna open a new one