astronomy-commons / hipscat-import

HiPSCat import - generate HiPSCat-partitioned catalogs
https://hipscat-import.readthedocs.io
BSD 3-Clause "New" or "Revised" License
5 stars 3 forks source link

Add ECSV reader #288

Closed delucchi-cmu closed 3 months ago

delucchi-cmu commented 3 months ago

Closes #225

Adds basic support for an ECSV reader. Note that the astropy ecsv reader does not implement a "fast" reader, so this method is not sped up by underlying C++, and it is not possible to chunk the reads into smaller tables.

See: https://docs.astropy.org/en/stable/io/ascii/read.html#reading-large-tables-in-chunks

codecov[bot] commented 3 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 99.36%. Comparing base (d67409b) to head (0fc4131).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #288 +/- ## ======================================= Coverage 99.35% 99.36% ======================================= Files 24 24 Lines 1246 1260 +14 ======================================= + Hits 1238 1252 +14 Misses 8 8 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.