Support reporting multiple measurements from one report

[andrewiggins]

Add support for reporting one table per measurement from the results of a Tachometer run. All benchmarks from the same measurement will be grouped together in summaries and result tables.

[github-actions[bot]]

📊 Tachometer Benchmark Results

Summary

• test_bench: unsure 🔍 -10% - +12% (-4.10ms - +5.24ms)
  ^{local-framework vs base-framework}
• test_bench_2: slower ❌ 8% - 35% (3.22ms - 11.96ms)
  ^{base-framework vs other-framework Customize summary}

Results

test_bench

• Browser: chrome-headless 83.0.4103.116
• Sample size: 60
• Commit: 1bc0918
• Built by: PR Multi Init Flow #25

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	32.09ms - 38.19ms	-	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -10% - +12% -4.10ms - +5.24ms	-

test_bench_2

• Browser: chrome-headless 83.0.4103.116
• Sample size: 60
• Commit: 1bc0918
• Built by: PR Multi Init Flow #25

Version	Avg time	vs other-framework	vs base-framework	vs local-framework	vs fast-framework
other-framework	43.30ms - 52.48ms	-	slower ❌ 19% - 54% 7.24ms - 18.26ms	unsure 🔍 -1% - +26% -0.40ms - +10.72ms	unsure 🔍 -3% - +24% -1.15ms - +10.34ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -22% - -0% -10.72ms - +0.40ms	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -21% - +2% -10.34ms - +1.15ms	-	unsure 🔍 -10% - +12% -4.10ms - +5.24ms
fast-framework	32.09ms - 38.19ms	faster ✔ 17% - 36% 7.24ms - 18.26ms	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms	-

_{tachometer-reporter-action for PR Multi Init Flow}

[github-actions[bot]]

📊 Tachometer Benchmark Results

Summary

• test_bench: unsure 🔍 -10% - +12% (-4.10ms - +5.24ms)
  ^{local-framework vs base-framework}

Results

test_bench

• Browser: chrome-headless 83.0.4103.116
• Sample size: 60
• Built by: PR Single Job #25
• Commit: 1bc0918

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	32.09ms - 38.19ms	-	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -10% - +12% -4.10ms - +5.24ms	-

_{tachometer-reporter-action for PR Single Job}

[github-actions[bot]]

📊 Tachometer Benchmark Results

Summary

• test-bench-1: unsure 🔍 -10% - +12% (-4.10ms - +5.24ms)
  ^{local-framework vs base-framework}
• test-bench-2: slower ❌ 8% - 35% (3.22ms - 11.96ms)
  ^{base-framework vs other-framework Customize summary}

Results

test-bench-1

• Browser: chrome-headless 83.0.4103.116
• Sample size: 60
• Commit: 1bc0918
• Built by: PR Setup Job Flow #25

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	32.09ms - 38.19ms	-	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -10% - +12% -4.10ms - +5.24ms	-

test-bench-2

• Browser: chrome-headless 83.0.4103.116
• Sample size: 60
• Commit: 1bc0918
• Built by: PR Setup Job Flow #25

Version	Avg time	vs other-framework	vs base-framework	vs local-framework	vs fast-framework
other-framework	43.30ms - 52.48ms	-	slower ❌ 19% - 54% 7.24ms - 18.26ms	unsure 🔍 -1% - +26% -0.40ms - +10.72ms	unsure 🔍 -3% - +24% -1.15ms - +10.34ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -22% - -0% -10.72ms - +0.40ms	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -21% - +2% -10.34ms - +1.15ms	-	unsure 🔍 -10% - +12% -4.10ms - +5.24ms
fast-framework	32.09ms - 38.19ms	faster ✔ 17% - 36% 7.24ms - 18.26ms	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms	-

_{tachometer-reporter-action for PR Setup Job Flow}