search

lancedb / lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
https://lancedb.github.io/lance/
Apache License 2.0
3.97k stars 224 forks source link

Make numpy optional pylance dependency #1216

Open wjones127 opened 1 year ago

wjones127 commented 1 year ago

I don't think it's required, and it adds ~15MB.

rishabhRsinghvi commented 1 year ago

Hello @wjones127, I would like to take this issue. Thank you.

jameswu1991 commented 2 months ago

for anyone who may have come across this issue wondering why numpy is locked to <2.0, i want to add a comment to make a cross-reference back to the PR that created the lock:

furthermore, it seems that pyarrow themselves are working with the idea of making numpy dependency optional:

since the pyarrow PR was only merged last week, i'd expect this to be a part of the upcoming pyarrow 18 release. once that is complete, perhaps making numpy dependency optional for pylance would be easier