-
There is a typo in the `llm_threshold` parameter that RestrictToTopic expects. The parameter is incorrectly spelled as `llm_theshold`.
ERROR:
```
File "/app/ai_guardrails/services/gd.py", line …
-
There are a few LLM observability tools we can integrate, but we need to check their feasibility first. For now, we can start with:
- [x] LangSmith
- [ ] Promptlayer
- [ ] LLMonitor
- [ ] Langfu…
-
Here's a scenario: we are running guardrails server, which uses FastAPI.
Let's imagine that we'd like to keep track of each user that is using our guardrails server.
For this, we could use `LoginMan…
-
I am trying to integrate Nemo Guardrails with our hosted LLM Model. For that, I have created a Custom LLM Class.
```py
class CustomLLM(BaseLanguageModel):
async def…
-
res =guardrails.invoke({"input":"How do I cook meat"})
0.5s
I'm defining a chain, not using it ! the llm is local, while the llm in the yml file is openAI
chain = print_func|(guardrails |llm)| …
-
Description:
I'm currently working on implementing guardrails for a text-to-SQL system with Langchain where a user submits a question, which is then converted into a SQL query by an LLM. The SQL qu…
-
**Describe the bug**
should be able to chain.invoke via the OpenAI callable in langchain and a base url pointing at a guardrails server but it errors on role of type None
**To Reproduce**
Steps t…
-
When [Langfuse](https://github.com/langfuse/langfuse/) is used for tracing (instead of Langsmith), the usage of NeMo-Guardrails in a Langchain chain completely breaks the tracing functionality.
The…
-
I run phi3 :ollama run phi3:3.8b
And I test:
`curl http://localhost:11434/api/generate -d '{
"model": "phi3:3.8b",
"prompt": "Why is the sky blue?",
"stream": false
}'` , I can got respons…
-
Title.
https://blog.streamlit.io/ai21_grounded_multi_doc_q-a/
https://arxiv.org/html/2404.09129v1
https://arxiv.org/pdf/2406.02543
https://huggingface.co/papers/2406.02543
https://huggingface…