pydata / sparse

Sparse multi-dimensional arrays for the PyData ecosystem
https://sparse.pydata.org
BSD 3-Clause "New" or "Revised" License
602 stars 126 forks source link

test: Converting elemwise_example.py to CodSpeed benchmark #749

Closed DeaMariaLeon closed 3 months ago

DeaMariaLeon commented 3 months ago

What type of PR is this? (check all applicable)

Related issues

Checklist


Please explain your changes below.

This PR converts elemwise_example.py that was already in the repo, to benchmarks for CodSpeed. There are 26 warnings locally, but they were also raised running the original file.

codspeed-hq[bot] commented 3 months ago

CodSpeed Performance Report

Merging #749 will degrade performances by 52.24%

Comparing DeaMariaLeon:elemwise (4c27833) with main (09adc98)

Summary

โŒ 2 (๐Ÿ‘ 2) regressions โœ… 215 untouched benchmarks

๐Ÿ†• 27 new benchmarks

Benchmarks breakdown

Benchmark main DeaMariaLeon:elemwise Change
๐Ÿ‘ test_index_fancy[side=100-rank=1-format='coo'] 678.5 ยตs 1,420.6 ยตs -52.24%
๐Ÿ‘ test_index_slice[side=100-rank=2-format='gcxs'] 2.4 ms 2.9 ms -18.04%
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='Finch'-side=1000] N/A 1.5 ms N/A
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='Finch'-side=100] N/A 713.2 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='Finch'-side=500] N/A 882 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='Numba'-side=1000] N/A 5.9 ms N/A
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='Numba'-side=100] N/A 4 ms N/A
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='Numba'-side=500] N/A 4.4 ms N/A
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='SciPy'-side=1000] N/A 612.3 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='SciPy'-side=100] N/A 552.6 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function add>-backend='SciPy'-side=500] N/A 572.4 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='Finch'-side=1000] N/A 1.4 ms N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='Finch'-side=100] N/A 706.2 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='Finch'-side=500] N/A 878.7 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='Numba'-side=1000] N/A 3.8 ms N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='Numba'-side=100] N/A 3 ms N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='Numba'-side=500] N/A 3.2 ms N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='SciPy'-side=1000] N/A 610.1 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='SciPy'-side=100] N/A 550.8 ยตs N/A
๐Ÿ†• test_elemwise[f=<built-in function gt>-backend='SciPy'-side=500] N/A 567.2 ยตs N/A
... ... ... ... ...


:information_source: Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

DeaMariaLeon commented 3 months ago

It took more than 40 min to run the benchmarks. (I think!)