search

apache / iceberg-python

Apache PyIceberg
https://py.iceberg.apache.org/
Apache License 2.0
478 stars 176 forks source link

Add benchmark to the CI #27

Open Fokko opened 1 year ago

Fokko commented 1 year ago

Feature Request / Improvement

Would be great to have a benchmark to detect regression in the CI. I think this can be part of the integration tests, where we create a table with multiple partitions. It would also be great to capture the number of requests to minio by tracking the logs.

Migrated from https://github.com/apache/iceberg/issues/8550

github-actions[bot] commented 7 months ago

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] commented 7 months ago

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'

sungwy commented 3 months ago

bump - not stale

sungwy commented 3 months ago

I think this will be important for us to implement before a 1.0.0 release to benchmark performances of certain operations before and after proposed changes. This will help us guard against introducing unexpected performance regressions in new releases.