search

n4ze3m / page-assist

Use your locally running AI models to assist you in your web browsing
https://chromewebstore.google.com/detail/page-assist-a-web-ui-for/jfgfiigpkhlkbnfnbobbkinehhfdhndo
MIT License
1.59k stars 151 forks source link

Embedding Feature #68

Open debasish-mohanty opened 6 months ago

debasish-mohanty commented 6 months ago

Can you provide options while creating chunks based on Sentences too, which will help on better answer from the knowledge base.

n4ze3m commented 6 months ago

Yes, we will add that in the next release. Currently, the page is using RecursiveCharacterTextSplitter from langchain.js

BradKML commented 6 months ago

Seconding this but more so on dynamic context chunking, and maybe chunking with "ensemble" or overlapping chunks (since long context LLMs are here) https://docs.llamaindex.ai/en/stable/examples/retrievers/ensemble_retrieval/ P.S. for reranking https://github.com/ollama/ollama/issues/3749