Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
Follow up to #3097.
We want to be able to handle delete, update, merge insert transactions. Also ideally should be able to handle update config ones too.