astronomy-commons / hats

Hierarchical Progressive Survey Catalog
https://hats.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
17 stars 5 forks source link

Introduce aggregate_column_statistics #387

Closed delucchi-cmu closed 1 day ago

delucchi-cmu commented 2 days ago

Change Description

Closes #329.

Introduces a method to read the footer statistics on a parquet dataset _metadata file and provide a report on the global minimum and maximum values.

codecov[bot] commented 2 days ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 92.83%. Comparing base (632292a) to head (d5ce329). Report is 1 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #387 +/- ## ========================================== + Coverage 92.75% 92.83% +0.08% ========================================== Files 48 48 Lines 1933 1955 +22 ========================================== + Hits 1793 1815 +22 Misses 140 140 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

github-actions[bot] commented 2 days ago
Before [632292a0] <v0.4.1> After [7d0b20aa] Ratio Benchmark (Parameter)
89.0±2ms 93.0±3ms 1.05 benchmarks.Suite.time_paths_creation
72.0±0.5ms 73.3±0.6ms 1.02 benchmarks.MetadataSuite.time_load_partition_info_order7
72.0±0.4ms 72.9±0.5ms 1.01 benchmarks.MetadataSuite.time_load_partition_join_info
43.6±0.5ms 44.0±0.5ms 1.01 benchmarks.Suite.time_pixel_tree_creation
18.1±0.4ms 18.0±0.3ms 0.99 benchmarks.MetadataSuite.time_load_partition_info_order6
13.3±0.4ms 13.1±0.4ms 0.99 benchmarks.Suite.time_inner_pixel_alignment
389±2ms 384±2ms 0.99 benchmarks.Suite.time_outer_pixel_alignment
125±1ms 124±0.8ms 0.99 benchmarks.time_test_alignment_even_sky
1.06±0.01ms 1.06±0ms 0.99 benchmarks.time_test_cone_filter_multiple_order

Click here to view all benchmarks.