lancedb / lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
https://lancedb.github.io/lance/
Apache License 2.0
3.97k stars 224 forks source link

Optimize write path with dynamodb #3154

Open wjones127 opened 8 hours ago

wjones127 commented 8 hours ago

Follow up to https://github.com/lancedb/lance/pull/3117. We added a test for Rename commit handler, but we should also try this with dynamodb.

Will likely include https://github.com/lancedb/lance/issues/2995