-
Hi,
I run the following sample script given in the README.md file after the installation of this evaluator with the command `guardrails hub install hub://arize-ai/relevancy_evaluator`.
```
import…
-
**Describe the bug**
I am trying to use the custom LLM wrapper so that I can add guardrails using a NVIDIA TensorRT LLM (TRT-LLM). I do not wish to use openai/azure openai for the guardrails call.
…
-
-
LLMs with public access typically require guardrails to prevent misuse and hacking. Guardrails will try to keep generated output safe and responsible, in accordance with SoilWise standards.
-
I am currently exploring the ways to integrate nemoguardrails to my existing RAG chatbot system.
**Guardrail Script**
```
config = RailsConfig.from_content(
yaml_content=YAML_C…
-
There are a few LLM observability tools we can integrate, but we need to check their feasibility first. For now, we can start with:
- [x] LangSmith
- [ ] Promptlayer
- [ ] LLMonitor
- [ ] Langfu…
-
Here's a scenario: we are running guardrails server, which uses FastAPI.
Let's imagine that we'd like to keep track of each user that is using our guardrails server.
For this, we could use `LoginMan…
-
There is a typo in the `llm_threshold` parameter that RestrictToTopic expects. The parameter is incorrectly spelled as `llm_theshold`.
ERROR:
```
File "/app/ai_guardrails/services/gd.py", line …
-
Hello!
After the input rail, when the library runs the ```generate_user_intent```, is there a way to stop further finding ```generate_next_step``` and ```generate_bot_message```. As we have a sepra…
-
**Describe the bug**
The only way to utilize Async clients for OpenAI 1.x in guardrails is to wrap it as a custom llm. This is because our identification criteria for OpenAI v1.x functions are weak …