NVIDIA / NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Other
4.22k stars 402 forks source link

Bot Example: Enhancing RAG with NVIDIA NIMs, NeMo Guardrails, LlamaGuard, and AlignScore #719

Closed abodhankar closed 3 months ago

abodhankar commented 3 months ago

This example helps developers learn how to integrate LlamaGuard, a safeguard LLM with NeMo Guardrails into our custom NVIDIA NIM-powered RAG pipeline to have more secure, moderated responses for user queries. Additionally, we also learn how to integrate the AlignScore metric to check the factual consistency of the LLM response with the retrieved chunks from the vector database.