Eventual-Inc / Daft

Distributed data engine for Python/SQL designed for the cloud, powered by Rust
https://getdaft.io
Apache License 2.0
2.38k stars 170 forks source link

[FEAT] SQL union/union all and sql intersect #3274

Closed universalmind303 closed 2 weeks ago

codspeed-hq[bot] commented 2 weeks ago

CodSpeed Performance Report

Merging #3274 will improve performances by 25.18%

Comparing universalmind303:union-unionall (5d23be3) with main (93c7868)

Summary

⚡ 2 improvements ✅ 15 untouched benchmarks

Benchmarks breakdown

Benchmark main universalmind303:union-unionall Change
test_iter_rows_first_row[100 Small Files] 297.9 ms 238 ms +25.18%
test_show[100 Small Files] 42.5 ms 38.2 ms +11.27%
universalmind303 commented 2 weeks ago

pinging @advancedxy as you've recently did some work on the set operations. I tried to follow the same pattern you established for Intersect

advancedxy commented 2 weeks ago

I will take a look at this today.