LSSTDESC / tables_io

A small package to provide tools to read / write and convert tabular data for DESC
MIT License
1 stars 1 forks source link

Chunked parquet reads #71

Closed delucchi-cmu closed 1 year ago

delucchi-cmu commented 1 year ago

Adds chunked reads to read parquet data into pandas data frame.

Follow-up PRs will address needs for specifying columns to read.

Fixes Issue #68

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 100.00% and no project coverage change.

Comparison is base (adde4fc) 100.00% compared to head (a600c91) 100.00%.

:exclamation: Current head a600c91 differs from pull request most recent head 30051a3. Consider uploading reports for the commit 30051a3 to get more accurate results

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #71 +/- ## ========================================= Coverage 100.00% 100.00% ========================================= Files 8 8 Lines 618 628 +10 ========================================= + Hits 618 628 +10 ``` | [Impacted Files](https://app.codecov.io/gh/LSSTDESC/tables_io/pull/71?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=LSSTDESC) | Coverage Δ | | |---|---|---| | [src/tables\_io/ioUtils.py](https://app.codecov.io/gh/LSSTDESC/tables_io/pull/71?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=LSSTDESC#diff-c3JjL3RhYmxlc19pby9pb1V0aWxzLnB5) | `100.00% <100.00%> (ø)` | | | [src/tables\_io/lazy\_modules.py](https://app.codecov.io/gh/LSSTDESC/tables_io/pull/71?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=LSSTDESC#diff-c3JjL3RhYmxlc19pby9sYXp5X21vZHVsZXMucHk=) | `100.00% <100.00%> (ø)` | |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.