pola-rs / polars

Dataframes powered by a multithreaded, vectorized query engine, written in Rust
https://docs.pola.rs
Other
30.35k stars 1.96k forks source link

implement all selectors in Rust #10594

Open ritchie46 opened 1 year ago

ritchie46 commented 1 year ago

Problem description

The selector API has proven to be a very successful proof of concept.

Now it is time to implement them directly in rust and let the python bindings dispatch to those implementations. This will be faster, have less memory allocations and ensures feature parity between all front-ends.

@alexander-beedie interested in this one? It is a nice rust dabble. :)

alexander-beedie commented 1 year ago

Sure - if you can start me off in the right direction it would be interesting to "promote" them into Rust :)

Going to work on the updates for database connectivity first though (been batting around a few light prototypes and a simple first-cut is starting to take shape).

stinodego commented 1 year ago

This would be a great addition. I love the selector functionality but strongly dislike having to handle these in every function/method on the Python side.