llm-tools / embedJs

A NodeJS RAG framework to easily work with LLMs and embeddings
https://llm-tools.mintlify.app/get-started/introduction
Apache License 2.0
327 stars 39 forks source link

Add post Context/Custom Meta to Loaders / Rag information to targetted Rag(id) #42

Open converseKarl opened 6 months ago

converseKarl commented 6 months ago

Is there anyway we can have another method to maybe tag the RAG (id), and enhance with meta data and resubmit. I think this would be a very powerful feature, to add meta data to individual media elements where its pulled for a source but you want to supplement it. Adding richer background context, and meta to say those webpages can really improve RAG a lot, it's performance, accuracy, and intelligence.

I've just been on some webinars today and this seemed to be a theme building up.

note : This is not the same as the initial prompt setting

adhityan commented 6 months ago

What will be the purpose of this additional metadata? Should that be passed to the LLM or sent back to the user as additional info from the selected similar documents from the vectorDB?