search

activeloopai / deeplake

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
https://activeloop.ai
Mozilla Public License 2.0
8.1k stars 622 forks source link

multidimensional array operations in Tensor Query Language #2213

Open dongheuw opened 1 year ago

dongheuw commented 1 year ago

How can I perform the multidimensional array operations written in your CIDR paper (https://arxiv.org/pdf/2209.10785.pdf)?

image

Tried on the platform but wasn't supported.

Thanks a lot in advance!

khustup commented 1 year ago

Hey @dongheuw TQL right now supports multidimensional array operations on the filtering expressions, such as WHERE, ORDER BY, SAMPLE BY. For example select * where any(logical_and(boxes[:,3]>500, categories == 'truck')) returns samples on coco-train which have at least one truck with height more than 500

Supporting then on tensor selection list is in progress and will be released soon. Thanks.