search

Eventual-Inc / Daft

Distributed DataFrame for Python designed for the cloud, powered by Rust
https://getdaft.io
Apache License 2.0
1.88k stars 121 forks source link

Optimizer: support ranges instead of just limits in pushdowns #2429

Open universalmind303 opened 3 weeks ago

universalmind303 commented 3 weeks ago

Is your feature request related to a problem? Please describe. A lot of sources support reading a range instead of just a limit.

Describe the solution you'd like Modify the Pushdowns to support a range, and update code to use ranges whenever possible

samster25 commented 2 weeks ago

Is this equivalent to something like an offset + a limit?

universalmind303 commented 2 weeks ago

Is this equivalent to something like an offset + a limit?

yes, exactly.