Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
Problem
Pyo3
can support async calls. https://pyo3.rs/v0.13.2/ecosystem/async-await.html .Because our rust APIs are all async calls, it is probably cheaper to directly implement them as async call from Python side?