infiniflow / infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text
https://infiniflow.org
Apache License 2.0
2.56k stars 269 forks source link

[Feature Request]: More examples are needed. #1490

Closed JinHai-CN closed 1 month ago

JinHai-CN commented 3 months ago

Describe what you'd like

We need more examples to show how to use tensor data search, tensor data reranker and structured data filter.

  1. Tensor data search. https://github.com/infiniflow/infinity/blob/main/example/tensor_search.py
  2. Structured data filter. https://github.com/infiniflow/infinity/blob/main/example/filter_data.py
  3. More complex hybrid search: https://github.com/infiniflow/infinity/blob/main/example/hybrid_search.py

Python SDK documents also need to update due to tensor and sparse data, index and search parameter.

bash99 commented 2 months ago

And Please don't use fake data for sparse/tense vector.

Just use some small embedding model to encode data.

JinHai-CN commented 2 months ago

And Please don't use fake data for sparse/tense vector.

Just use some small embedding model to encode data.

Ok, we will also provide some examples using real data.