Closed njzjz closed 1 month ago
The recent updates focus on bolstering testing capabilities through the introduction of benchmark testing for a Python package. The project now features a GitHub Actions workflow (benchmark.yml
) that sets up Python, installs dependencies, and executes benchmarks using CodSpeedHQ. Furthermore, the pyproject.toml
file now includes pytest
and pytest-codspeed
in the benchmark section to support these new tests. A new test file, test_import.py
, has been added to assess importing dpdata
and its command line interface.
File(s) | Change Summary |
---|---|
.github/workflows/benchmark.yml |
Introduces a GitHub Actions workflow for running benchmarks using CodSpeedHQ. |
pyproject.toml |
Added pytest and pytest-codspeed to the benchmark section. |
tests/benchmark/test_import.py |
Added benchmark tests for importing dpdata and testing the dpdata command line interface. |
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 83.63%. Comparing base (
8b9fd0f
) to head (cd9cc4f
). Report is 1 commits behind head on devel.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
๐
2 new benchmarks were detected.
You will start to see performance impacts in the reports once the benchmarks are run from your default branch.
Hey @njzjz, I am a co-founder @CodSpeedHQ, glad to see you trying out our tool!
You use the CodSpeed action inside a matrix, thus running the action 3 times with different Python versions. However, this will not work properly as CodSpeed is built to run only once per PR. There might be instances where the job is picked up correctly, and not the same Python version will be picked up each time.
I recommend that you create a separate workflow file or job with a single Python version and single use of the CodSpeed action. I recommend using Python 3.12, so that you can benefit from the automated flamegraphs in the CodSpeed UI ๐
I recommend that you create a separate workflow file or job with a single Python version and single use of the CodSpeed action. I recommend using Python 3.12, so that you can benefit from the automated flamegraphs in the CodSpeed UI ๐
Thanks for your friendly reminder!
Do a benchmark before working on #526
Summary by CodeRabbit
pytest
andpytest-codspeed
into the project for enhanced testing capabilities.