llm-tools / embedJs

A NodeJS RAG framework to easily work with LLMs and embeddings
https://llm-tools.mintlify.app/get-started/introduction
Apache License 2.0
331 stars 41 forks source link

Implement system prompt #144

Closed leVoT8 closed 3 weeks ago

leVoT8 commented 3 weeks ago

🚀 The feature

It would be great to to see EmbedJS have the ability to not only query via a user prompt but also implement a system prompt.

Motivation, pitch

I am seeking to create a custom GPT with RAG. It appears EmbedJS only offers a user prompt to be implemented, and not a system prompt. I would love the ability to be able to implement a system prompt as well.

adhityan commented 3 weeks ago

Actually EmbedJs already uses system prompts and this can be configured. Check out my reply on this discussion for more details on how to do it https://github.com/llm-tools/embedJs/discussions/141.

You can read more about this against the method setQueryTemplate in the API Reference https://llm-tools.mintlify.app/api-reference/overview. I will update the documentation to make this more clear.

leVoT8 commented 3 weeks ago

Thank you!