Eventual-Inc / Daft

Distributed data engine for Python/SQL designed for the cloud, powered by Rust
https://getdaft.io
Apache License 2.0
2.34k stars 164 forks source link

[FEAT] connect: collect #3326

Closed andrewgazelka closed 1 day ago

andrewgazelka commented 2 days ago

This stack of pull requests is managed by Graphite. Learn more about stacking.

codspeed-hq[bot] commented 2 days ago

CodSpeed Performance Report

Merging #3326 will improve performances by 61.17%

Comparing andrew/connect-collect (099354a) with main (5fee192)

Summary

âš¡ 1 improvements
✅ 16 untouched benchmarks

Benchmarks breakdown

Benchmark main andrew/connect-collect Change
âš¡ test_show[100 Small Files] 24.2 ms 15 ms +61.17%
codecov[bot] commented 1 day ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 77.26%. Comparing base (5fee192) to head (099354a). Report is 1 commits behind head on main.

Additional details and impacted files [![Impacted file tree graph](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/3326/graphs/tree.svg?width=650&height=150&src=pr&token=J430QVFE89&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc)](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/3326?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc) ```diff @@ Coverage Diff @@ ## main #3326 +/- ## ========================================== - Coverage 77.41% 77.26% -0.16% ========================================== Files 678 678 Lines 83680 83476 -204 ========================================== - Hits 64783 64495 -288 - Misses 18897 18981 +84 ``` [see 16 files with indirect coverage changes](https://app.codecov.io/gh/Eventual-Inc/Daft/pull/3326/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Eventual-Inc)

🚨 Try these New Features:

kevinzwang commented 1 day ago

@andrewgazelka should this PR have the implementation of collect in it? I only see the test

andrewgazelka commented 1 day ago

It is implemented as part of the client library and not the server, so we need no implementation to get it to work.

andrewgazelka commented 1 day ago

Merge activity