search

NVIDIA / NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Other
4.15k stars 390 forks source link

Support for local LLM Model Web Server #27

Open smeet2804 opened 1 year ago

smeet2804 commented 1 year ago

Can I use nemoguardrails for local web server like gpt4all instead of openai server? Or through HuggingFace inference api? Ref: https://github.com/nomic-ai/gpt4all

drazvan commented 1 year ago

This will be added to the main branch this week and published to PyPI early next week when we'll release a new version.

smeet2804 commented 1 year ago

Sounds cool! Looking forward to it. Thanks!

AIAnytime commented 1 year ago

Is this done? Can we use it with OPEN SOURCE LLM?

AIAnytime commented 1 year ago

what happened?