Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
We often expose internal APIs. These APIs are
pub
but really shouldn't be used as we will not garueentee the stability.Maybe we could use
depercated
mechanism to generate a warning when someone touches these APIs.Maybe there is a better way, this ticket is to track and solve this problem.