How to connect with the knowledge base

[anan1213095357]

How to connect with the knowledge base

[mili-tan]

Maybe you should try LangChain or Semantic Kernel, or learn how Retrieval Augmented Generation (RAG) works and implement the search yourself using OllamaApiClient.GenerateEmbeddings and some vector database.

[anan1213095357]

Maybe you should try LangChain or Semantic Kernel, or learn how Retrieval Augmented Generation (RAG) works and implement the search yourself using OllamaApiClient.GenerateEmbeddings and some vector database.

I understand that retrieval vectors can be saved, but how can the vectors obtained through GenerateEmbedding be output as text?

[mili-tan]

I understand that retrieval vectors can be saved, but how can the vectors obtained through GenerateEmbedding be output as text?

It doesn't seem to work like that way, the vectors resulting from Embedding are only used to compare similarity distances. You may need to make the association between the vectors and the original text yourself. Vector databases can usually have text or id attached to them. https://platform.openai.com/docs/tutorials/web-qa-embeddings

[awaescher]

This is not in the context of the Ollama API alone, so it's out of range of this project. @mili-tan is right, you should use langchain or semantic kernel for this. There are tons of articles out there, I think this one is a good one to start:

• https://www.kaggle.com/code/deeepsig/rag-using-langchain-chromadb-ollama-and-gemma-7b/notebook