search

llm-tools / embedJs

A NodeJS RAG framework to easily work with LLMs and embeddings
https://llm-tools.mintlify.app/get-started/introduction
Apache License 2.0
334 stars 40 forks source link

Ollama feature branch #48

Closed markomanninen closed 6 months ago

markomanninen commented 6 months ago

This PR consists of a Node.js example application that uses vector embeddings with the embedJs RAG module to store the text from various sources in the in-memory vector database, retrieve them with similarity search, and inference results with Ollama Large Language Models.

The main motivation for including Ollama is on the open-source and local running of the RAG applications.

Local embeddings codes have been removed from the PR, and only Ollama's new model-specific changes are maintained.

VCS has structured the README content table a bit. I intended to add only the Ollama part.

adhityan commented 6 months ago

LGTM. I will merge this now. Changes will be available with the next library version towards end of this week.

adhityan commented 6 months ago

There is a conflict with main atm. Could you resolve and push again?

markomanninen commented 6 months ago

Conflicts solved. Can you get the code from the last PR?