intelligentnode / IntelliNode

Access the latest AI models like ChatGPT, LLaMA, Diffusion, Gemini Hugging face, and beyond through a unified prompt layer and performance evaluation
https://show.intellinode.ai
Apache License 2.0
216 stars 14 forks source link

Implement semantic search iteration functionality (semanticSearchPages) #6

Closed Barqawiz closed 11 months ago

Barqawiz commented 1 year ago

extend SemanticSearch function to track the top matches over large data.

The SemanticSearchPages will navigate the data in (n) chunks, get the top items of each chunk and cache it in the object.

Differences: SemanticSearch is general without status. SemanticSearchPages will cache the top matches status and compare it with every added chunk.

Barqawiz commented 11 months ago

This functionality implemented through SemanticSearchPaging