search

llm-tools / embedJs

A NodeJS RAG framework to easily work with LLMs and embeddings
https://llm-tools.mintlify.app/get-started/introduction
Apache License 2.0
331 stars 41 forks source link

Support Local LLM Models。 #132

Closed BingKui closed 1 week ago

BingKui commented 1 month ago

🚀 The feature

I run a local model by node-llama-cpp。I hope To use it。

Motivation, pitch

I will make another application of end-side large model, using node-llama-cpp to run the end-side large model, hoping to realize the function of RAG.

adhityan commented 1 week ago

This is supported from version 0.1.18