Eventual-Inc / Daft

Distributed DataFrame for Python designed for the cloud, powered by Rust
https://getdaft.io
Apache License 2.0
1.76k stars 105 forks source link

[FEAT] Read from LanceDB #2195

Closed jaychia closed 2 weeks ago

jaychia commented 2 weeks ago

Adds the ability to read a Lance dataset: https://lancedb.github.io/lance/read_and_write.html

codecov[bot] commented 2 weeks ago

Codecov Report

Attention: Patch coverage is 82.85714% with 18 lines in your changes are missing coverage. Please review.

:exclamation: No coverage uploaded for pull request base (main@ce7cec5). Click here to learn what that means. Report is 3 commits behind head on main.

Additional details and impacted files [![Impacted file tree graph](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/2195/graphs/tree.svg?width=650&height=150&src=pr&token=J430QVFE89&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc)](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/2195?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc) ```diff @@ Coverage Diff @@ ## main #2195 +/- ## ======================================= Coverage ? 85.42% ======================================= Files ? 71 Lines ? 7514 Branches ? 0 ======================================= Hits ? 6419 Misses ? 1095 Partials ? 0 ``` | [Files](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/2195?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc) | Coverage Δ | | |---|---|---| | [daft/\_\_init\_\_.py](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/2195?src=pr&el=tree&filepath=daft%2F__init__.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc#diff-ZGFmdC9fX2luaXRfXy5weQ==) | `24.24% <ø> (ø)` | | | [daft/delta\_lake/delta\_lake\_scan.py](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/2195?src=pr&el=tree&filepath=daft%2Fdelta_lake%2Fdelta_lake_scan.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc#diff-ZGFmdC9kZWx0YV9sYWtlL2RlbHRhX2xha2Vfc2Nhbi5weQ==) | `95.34% <100.00%> (ø)` | | | [daft/io/\_\_init\_\_.py](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/2195?src=pr&el=tree&filepath=daft%2Fio%2F__init__.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc#diff-ZGFmdC9pby9fX2luaXRfXy5weQ==) | `95.83% <100.00%> (ø)` | | | [daft/io/\_lance.py](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/2195?src=pr&el=tree&filepath=daft%2Fio%2F_lance.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc#diff-ZGFmdC9pby9fbGFuY2UucHk=) | `92.85% <92.85%> (ø)` | | | [daft/io/object\_store\_options.py](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/2195?src=pr&el=tree&filepath=daft%2Fio%2Fobject_store_options.py&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc#diff-ZGFmdC9pby9vYmplY3Rfc3RvcmVfb3B0aW9ucy5weQ==) | `69.56% <69.56%> (ø)` | |