NVIDIA / NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Other
4.02k stars 367 forks source link

doc: NVIDIA API Catalog and NIMs #545

Closed Pouyanpi closed 2 months ago

Pouyanpi commented 3 months ago

Summary

This PR enhances the README.md with added instructions for interfacing with the NVIDIA API Catalog and NVIDIA NIMs.

The update confirms that ChatNVIDIA is compatible with local NIM instances.

Please note, the nvidia_ai_endpoints remains unchanged as an engine. Please let me know if there is any plan to change it to nim.

Thanks