search

astronomy-commons / hipscat-import

HiPSCat import - generate HiPSCat-partitioned catalogs
https://hipscat-import.readthedocs.io
BSD 3-Clause "New" or "Revised" License
5 stars 3 forks source link

Only read required columns in mapping stage. #262

Closed delucchi-cmu closed 5 months ago

delucchi-cmu commented 5 months ago

Change Description

Related to Issue #225.

I wanted to speed up the ECSV reads by only reading the columns we need during the mapping stage. It's relevant for all kinds of file readers, though.

codecov[bot] commented 5 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 99.42%. Comparing base (f2617e9) to head (732f65e).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #262 +/- ## ======================================= Coverage 99.42% 99.42% ======================================= Files 24 24 Lines 1219 1221 +2 ======================================= + Hits 1212 1214 +2 Misses 7 7 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.