search

coiled / benchmarks

BSD 3-Clause "New" or "Revised" License
28 stars 17 forks source link

⚠️ CI failed ⚠️ - test_join_big & test_set_index - regressions #1442

Closed github-actions[bot] closed 6 months ago

github-actions[bot] commented 6 months ago

Workflow Run URL

milesgranger commented 6 months ago
category type mean last last-1 last-2 threshold
('coiled-upstream-py3.9', 'test_join_big[0.1]', 'duration') [s] benchmarks duration 6.84634 21.7947 23.0729 19.9877 7.84634
('coiled-upstream-py3.9', 'test_join_big[0.1]', 'average_memory') [GiB] benchmarks average_memory 2.26741 5.50473 5.4982 5.69252 3.26741
('coiled-upstream-py3.9', 'test_join_big[0.1]', 'peak_memory') [GiB] benchmarks peak_memory 3.18022 7.5421 7.81987 7.76437 4.18022
('coiled-upstream-py3.9', 'test_join_big[1]', 'duration') [s] benchmarks duration 74.762 404.682 405.566 356.639 84.1767
('coiled-upstream-py3.9', 'test_join_big[1]', 'average_memory') [GiB] benchmarks average_memory 2.78203 6.76069 6.69796 7.03083 3.78203
('coiled-upstream-py3.9', 'test_join_big[1]', 'peak_memory') [GiB] benchmarks peak_memory 3.31459 8.39673 8.10687 8.17676 4.31459
('coiled-upstream-py3.9', 'test_set_index[0.1-False]', 'duration') [s] benchmarks duration 2.02772 15.0691 14.1167 13.179 3.02772
('coiled-upstream-py3.9', 'test_set_index[0.1-False]', 'average_memory') [GiB] benchmarks average_memory 1.81949 5.49293 5.45659 5.63402 2.81949
('coiled-upstream-py3.9', 'test_set_index[0.1-False]', 'peak_memory') [GiB] benchmarks peak_memory 2.99038 11.5783 11.2702 11.7719 3.99038
('coiled-upstream-py3.9', 'test_set_index[0.1-True]', 'duration') [s] benchmarks duration 2.62029 13.7865 13.1004 12.0754 3.62029
('coiled-upstream-py3.9', 'test_set_index[0.1-True]', 'average_memory') [GiB] benchmarks average_memory 3.60402 11.0565 10.9048 10.9926 4.79957
('coiled-upstream-py3.9', 'test_set_index[0.1-True]', 'peak_memory') [GiB] benchmarks peak_memory 8.64117 18.2989 18.8815 18.1623 10.7156
('coiled-upstream-py3.9', 'test_set_index[1-False]', 'duration') [s] benchmarks duration 12.5916 234.023 222.072 197.335 14.3003
('coiled-upstream-py3.9', 'test_set_index[1-False]', 'average_memory') [GiB] benchmarks average_memory 2.60564 6.34071 6.33104 6.63844 3.60564
('coiled-upstream-py3.9', 'test_set_index[1-False]', 'peak_memory') [GiB] benchmarks peak_memory 3.21892 9.7566 10.2593 9.95949 4.21892
('coiled-upstream-py3.9', 'test_set_index[1-True]', 'duration') [s] benchmarks duration 32.6117 340.755 330.381 323.875 36.5775
('coiled-upstream-py3.9', 'test_set_index[1-True]', 'average_memory') [GiB] benchmarks average_memory 35.6288 41.8765 41.8718 42.0595 36.6288
phofl commented 6 months ago

This is definitely expected. Previously, we optimized set index away and did joins with less data