search

abstractqqq / polars_ds_extension

Polars extension for general data science use cases
MIT License
261 stars 17 forks source link

Improve Performance by passing more code down to ndarray #154

Open abstractqqq opened 1 month ago

abstractqqq commented 1 month ago

There are still some hand written Rust code that computes things like dot product, L2 distances, etc. Ndarray has shown better performance and given current use cases, it will be 0 cost to cast underlying data to ndarrays.

abstractqqq commented 1 month ago

For distance function in KNN, I suspect using a function reference is slowing down execution.