ci: Run in Ubuntu Noble to support r-universe binaries

tidyverse / duckplyr

A drop-in replacement for dplyr, powered by DuckDB for performance.

Other

288 stars 19 forks source link

This is how benchmark results would change (along with a 95% confidence interval in relative change) if b432d280fd0d13fb32c34101487ce13daff4067d is merged into main:

:heavy_check_mark:001_tpch_01: 24.1ms -> 24.9ms [-0.61%, +6.46%]
:heavy_check_mark:001_tpch_02: 126ms -> 125ms [-1.95%, +1.01%]
:heavy_check_mark:001_tpch_03: 66.5ms -> 65.7ms [-4.34%, +1.81%]
:heavy_check_mark:001_tpch_04: 24.2ms -> 24ms [-2.9%, +1.33%]
:heavy_check_mark:001_tpch_05: 122ms -> 122ms [-1.73%, +1.19%]
:heavy_check_mark:001_tpch_06: 15ms -> 15ms [-1.72%, +1.7%]
:heavy_check_mark:001_tpch_07: 142ms -> 141ms [-2.36%, +0.35%]
:heavy_check_mark:001_tpch_08: 159ms -> 159ms [-1.28%, +1.62%]
:heavy_check_mark:001_tpch_09: 128ms -> 128ms [-1.12%, +1.13%]
:heavy_check_mark:001_tpch_10: 74.9ms -> 75ms [-1.17%, +1.47%]
:heavy_check_mark:001_tpch_11: 62.6ms -> 63.7ms [-0.16%, +3.72%]
:heavy_check_mark:001_tpch_12: 29.2ms -> 29.2ms [-1.82%, +1.47%]
:heavy_check_mark:001_tpch_13: 20.3ms -> 20.1ms [-3.56%, +0.67%]
:heavy_check_mark:001_tpch_14: 21.8ms -> 21.6ms [-2.98%, +1.31%]
:heavy_check_mark:001_tpch_15: 66.2ms -> 67ms [-0.86%, +3.24%]
:heavy_check_mark:001_tpch_16: 67.6ms -> 66.9ms [-2.63%, +0.7%]
:heavy_check_mark:001_tpch_17: 28.2ms -> 28.3ms [-1.59%, +1.96%]
:heavy_check_mark:001_tpch_18: 24ms -> 23.8ms [-3.22%, +1.72%]
:heavy_check_mark:001_tpch_19: 131ms -> 132ms [-1.16%, +2.5%]
:heavy_check_mark:001_tpch_20: 77.4ms -> 78.5ms [-1%, +3.93%]
:heavy_check_mark:001_tpch_21: 173ms -> 174ms [-0.52%, +2.24%]
:heavy_check_mark:001_tpch_22: 125ms -> 124ms [-2.08%, +0.49%]
:heavy_check_mark:010_tpch_01: 82.8ms -> 83.7ms [-2.26%, +4.54%]
:heavy_check_mark:010_tpch_02: 73ms -> 71.9ms [-3.96%, +0.91%]
:heavy_check_mark:010_tpch_03: 66ms -> 65.8ms [-1.9%, +1.26%]
:rocket:010_tpch_04: 52.5ms -> 49.9ms [-9.46%, -0.16%]
:heavy_check_mark:010_tpch_05: 94.9ms -> 94.7ms [-1.58%, +1.27%]
:heavy_check_mark:010_tpch_06: 35.9ms -> 36.2ms [-6.37%, +7.82%]
:heavy_check_mark:010_tpch_07: 115ms -> 117ms [-2.21%, +4.9%]
:heavy_check_mark:010_tpch_08: 136ms -> 137ms [-1.89%, +4.51%]
:heavy_check_mark:010_tpch_09: 120ms -> 118ms [-3.74%, +1.35%]
:heavy_check_mark:010_tpch_10: 85ms -> 85.5ms [-2.76%, +3.84%]
:heavy_check_mark:010_tpch_11: 38.5ms -> 38.7ms [-3.19%, +4.11%]
:heavy_check_mark:010_tpch_12: 62.5ms -> 62.7ms [-1.25%, +1.76%]
:heavy_check_mark:010_tpch_13: 53.3ms -> 52.4ms [-3.86%, +0.55%]
:heavy_check_mark:010_tpch_14: 42.6ms -> 42.3ms [-5.45%, +3.58%]
:heavy_check_mark:010_tpch_15: 59ms -> 59.2ms [-6.37%, +6.91%]
:heavy_check_mark:010_tpch_16: 44.4ms -> 44.8ms [-1.62%, +3.59%]
:heavy_check_mark:010_tpch_17: 55ms -> 55.9ms [-2.26%, +5.66%]
:heavy_check_mark:010_tpch_18: 55ms -> 54.1ms [-8.28%, +4.87%]
:heavy_check_mark:010_tpch_19: 121ms -> 122ms [-0.38%, +1.23%]
:heavy_check_mark:010_tpch_20: 71.3ms -> 71.6ms [-2.13%, +3.07%]
:heavy_check_mark:010_tpch_21: 415ms -> 410ms [-2.69%, +0.47%]
:heavy_check_mark:010_tpch_22: 77.2ms -> 76.5ms [-2.82%, +0.89%]
:heavy_check_mark:100_tpch_01: 1.22s -> 1.2s [-7.7%, +4.93%]
:heavy_check_mark:100_tpch_02: 123ms -> 126ms [-10.57%, +16.12%]
:heavy_check_mark:100_tpch_03: 1.1s -> 1.09s [-4.26%, +2.74%]
:heavy_check_mark:100_tpch_04: 1.08s -> 1.07s [-1.92%, +1.19%]
:exclamation::snail:100_tpch_05: 1.17s -> 1.2s [+0.79%, +3.25%]
:heavy_check_mark:100_tpch_06: 996ms -> 999ms [-2.48%, +3.23%]
:heavy_check_mark:100_tpch_07: 1.13s -> 1.16s [-1.29%, +6.32%]
:heavy_check_mark:100_tpch_08: 1.17s -> 1.17s [-2.47%, +3.1%]
:exclamation::snail:100_tpch_09: 1.25s -> 1.28s [+0.04%, +4.94%]
:heavy_check_mark:100_tpch_10: 1.12s -> 1.12s [-4.05%, +4.07%]
:heavy_check_mark:100_tpch_11: 81.8ms -> 90.9ms [-9.98%, +32.21%]
:heavy_check_mark:100_tpch_12: 1.11s -> 1.11s [-1.88%, +1.71%]
:heavy_check_mark:100_tpch_13: 344ms -> 359ms [-12.14%, +21.05%]
:heavy_check_mark:100_tpch_14: 1.05s -> 1.06s [-3.69%, +5.91%]
:heavy_check_mark:100_tpch_15: 1.15s -> 1.16s [-8.67%, +10.87%]
:heavy_check_mark:100_tpch_16: 126ms -> 128ms [-7.55%, +9.32%]
:heavy_check_mark:100_tpch_17: 1.1s -> 1.08s [-6.01%, +2.74%]
:heavy_check_mark:100_tpch_18: 1.13s -> 1.11s [-5.44%, +1.18%]
:heavy_check_mark:100_tpch_19: 1.21s -> 1.22s [-2.85%, +3.72%]
:heavy_check_mark:100_tpch_20: 1.11s -> 1.1s [-2.79%, +2.05%]
:heavy_check_mark:100_tpch_21: 2.3s -> 2.22s [-7.82%, +0.99%]
:heavy_check_mark:100_tpch_22: 176ms -> 170ms [-13.9%, +6.31%]

Further explanation regarding interpretation and methodology can be found in the documentation.

This is how benchmark results would change (along with a 95% confidence interval in relative change) if 333ed0a777505b04350a8c48f094b82583d3a942 is merged into main:

:heavy_check_mark:001_tpch_01: 24.2ms -> 24.9ms [-1.45%, +6.78%]
:heavy_check_mark:001_tpch_02: 131ms -> 131ms [-1.15%, +1.5%]
:heavy_check_mark:001_tpch_03: 70.7ms -> 69.6ms [-3.09%, +0.05%]
:heavy_check_mark:001_tpch_04: 24.8ms -> 24.8ms [-2.23%, +1.75%]
:heavy_check_mark:001_tpch_05: 129ms -> 128ms [-1.82%, +1.16%]
:exclamation::snail:001_tpch_06: 15.3ms -> 15.7ms [+0.56%, +5%]
:rocket:001_tpch_07: 144ms -> 142ms [-2.31%, -0.38%]
:rocket:001_tpch_08: 164ms -> 162ms [-1.73%, -0.1%]
:heavy_check_mark:001_tpch_09: 134ms -> 134ms [-1.34%, +0.77%]
:heavy_check_mark:001_tpch_10: 78.6ms -> 78.6ms [-1.69%, +1.71%]
:heavy_check_mark:001_tpch_11: 66.5ms -> 65.7ms [-3.51%, +0.92%]
:heavy_check_mark:001_tpch_12: 29.4ms -> 28.9ms [-4.13%, +0.51%]
:heavy_check_mark:001_tpch_13: 20.2ms -> 20.3ms [-3.17%, +4.57%]
:heavy_check_mark:001_tpch_14: 21.4ms -> 21.6ms [-0.73%, +2.61%]
:heavy_check_mark:001_tpch_15: 66.3ms -> 66.1ms [-2.55%, +1.74%]
:heavy_check_mark:001_tpch_16: 68.2ms -> 68.3ms [-2.18%, +2.4%]
:heavy_check_mark:001_tpch_17: 27.7ms -> 28ms [-0.77%, +2.38%]
:heavy_check_mark:001_tpch_18: 23.8ms -> 24ms [-1.21%, +3.38%]
:heavy_check_mark:001_tpch_19: 136ms -> 135ms [-2.32%, +1.03%]
:heavy_check_mark:001_tpch_20: 87.3ms -> 86.5ms [-2.65%, +0.63%]
:heavy_check_mark:001_tpch_21: 193ms -> 191ms [-2.66%, +0.45%]
:heavy_check_mark:001_tpch_22: 130ms -> 129ms [-2.56%, +0.31%]
:heavy_check_mark:010_tpch_01: 89.2ms -> 86.9ms [-8.52%, +3.4%]
:heavy_check_mark:010_tpch_02: 74.3ms -> 73.6ms [-2.68%, +0.83%]
:heavy_check_mark:010_tpch_03: 68.8ms -> 68.8ms [-3.07%, +3.2%]
:heavy_check_mark:010_tpch_04: 50.5ms -> 50.9ms [-1.44%, +3.19%]
:heavy_check_mark:010_tpch_05: 97.2ms -> 97.5ms [-2.23%, +2.94%]
:heavy_check_mark:010_tpch_06: 38.1ms -> 37.4ms [-7.85%, +4.37%]
:heavy_check_mark:010_tpch_07: 115ms -> 116ms [-0.87%, +2.59%]
:heavy_check_mark:010_tpch_08: 135ms -> 136ms [-1.1%, +2.27%]
:heavy_check_mark:010_tpch_09: 121ms -> 119ms [-2.74%, +0.45%]
:heavy_check_mark:010_tpch_10: 85.8ms -> 85.4ms [-2.14%, +1.39%]
:heavy_check_mark:010_tpch_11: 39.1ms -> 38.9ms [-4.17%, +3.07%]
:exclamation::snail:010_tpch_12: 62.6ms -> 63.2ms [+0.26%, +1.76%]
:heavy_check_mark:010_tpch_13: 54.8ms -> 55.5ms [-2.17%, +4.68%]
:exclamation::snail:010_tpch_14: 42.6ms -> 43.7ms [+0.62%, +4.66%]
:heavy_check_mark:010_tpch_15: 58.9ms -> 60.9ms [-6.7%, +13.42%]
:heavy_check_mark:010_tpch_16: 45.7ms -> 45.6ms [-3.13%, +2.69%]
:rocket:010_tpch_17: 57.8ms -> 56.1ms [-5.54%, -0.3%]
:heavy_check_mark:010_tpch_18: 54.3ms -> 56ms [-4.68%, +10.92%]
:heavy_check_mark:010_tpch_19: 124ms -> 130ms [-1%, +10.24%]
:heavy_check_mark:010_tpch_20: 74.6ms -> 74.4ms [-3.31%, +2.96%]
:exclamation::snail:010_tpch_21: 424ms -> 429ms [+0.14%, +2.17%]
:heavy_check_mark:010_tpch_22: 78.3ms -> 77.6ms [-2.53%, +0.9%]
:heavy_check_mark:100_tpch_01: 1.25s -> 1.24s [-6.16%, +4.84%]
:heavy_check_mark:100_tpch_02: 125ms -> 123ms [-4.79%, +1.87%]
:heavy_check_mark:100_tpch_03: 1.13s -> 1.13s [-1.49%, +2.46%]
:heavy_check_mark:100_tpch_04: 1.1s -> 1.1s [-1.46%, +0.94%]
:heavy_check_mark:100_tpch_05: 1.21s -> 1.22s [-3.28%, +4.42%]
:heavy_check_mark:100_tpch_06: 1.05s -> 1.05s [-4.27%, +4.29%]
:heavy_check_mark:100_tpch_07: 1.17s -> 1.17s [-2.04%, +1.95%]
:heavy_check_mark:100_tpch_08: 1.2s -> 1.18s [-5.58%, +2.36%]
:heavy_check_mark:100_tpch_09: 1.28s -> 1.29s [-1.66%, +2.55%]
:heavy_check_mark:100_tpch_10: 1.15s -> 1.15s [-2.66%, +2.87%]
:heavy_check_mark:100_tpch_11: 82.7ms -> 83ms [-1.51%, +2.24%]
:heavy_check_mark:100_tpch_12: 1.13s -> 1.15s [-2.32%, +5.36%]
:heavy_check_mark:100_tpch_13: 324ms -> 333ms [-2.37%, +7.58%]
:heavy_check_mark:100_tpch_14: 1.06s -> 1.06s [-1.17%, +2.84%]
:heavy_check_mark:100_tpch_15: 1.14s -> 1.16s [-2.67%, +4.78%]
:heavy_check_mark:100_tpch_16: 131ms -> 129ms [-16.17%, +13.84%]
:heavy_check_mark:100_tpch_17: 1.09s -> 1.1s [-1.89%, +2.19%]
:heavy_check_mark:100_tpch_18: 1.15s -> 1.14s [-2.09%, +1.03%]
:heavy_check_mark:100_tpch_19: 1.25s -> 1.26s [-5.04%, +7.24%]
:heavy_check_mark:100_tpch_20: 1.12s -> 1.11s [-1.37%, +1.03%]
:heavy_check_mark:100_tpch_21: 2.23s -> 2.26s [-3.98%, +7.29%]
:heavy_check_mark:100_tpch_22: 180ms -> 173ms [-18.86%, +11.82%]

Further explanation regarding interpretation and methodology can be found in the documentation.

tidyverse / duckplyr

ci: Run in Ubuntu Noble to support r-universe binaries #352