search

llm-tools / embedJs

A NodeJS RAG framework to easily work with LLMs and embeddings
https://llm-tools.mintlify.app/get-started/introduction
Apache License 2.0
334 stars 40 forks source link

Can you create functions other than for OpenAI? For example, maybe for OpenLLM? #1

Closed putuoka closed 12 months ago

putuoka commented 1 year ago

Since I don't have an API key to try embedding with OpenAI, perhaps there is a free or open-source option available.

adhityan commented 1 year ago

Hello @putuoka, sorry about the delayed response.

OpenAI does have credits to begin with which covers embeddings. There are open source embedding models supported with the library as well - which also have a free tier.

There is a plan to add support for the free open source embedding models in Hugging Face but that requires a lot of work - these are not well supported for consumption outside Python. If you want, we can colloborate on a PR for that.

Resources -

  1. https://openai.com/pricing
  2. https://cohere.com/embeddings
adhityan commented 12 months ago

Closing this issue as there is nothing more to add atm.