search

lancedb / lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
https://lancedb.github.io/lance/
Apache License 2.0
3.96k stars 221 forks source link

add decode tests for `schedule_ranges` #2952

Open broccoliSpicy opened 1 month ago

broccoliSpicy commented 1 month ago

the current tests in check_round_trip_encoding_inner function in rust/lance-encoding/src/testing.rs only test schedule ranges one by one.

broccoliSpicy commented 1 month ago

don't know how to trigger it end to end yet, but there seem to have problem with bitmap decoder. For example, when do RUST_BACKTRACE=1 cargo test test_value_primitive -- --nocapture in https://github.com/broccoliSpicy/lance/tree/test_schedule_ranges