-
**Is your feature request related to a problem? Please describe.**
My understanding of the documentation and the code is that `llm-guard` will lazy-load the models required by the chosen scanners fro…
-
Would love to see Llama-Guard2 tested on the PINT benchmark!
-
### 🐛 Describe the bug
Hi,
We use `torch.compile` to run GPTJ3.6B model training on our GPU platforms, while we got some dynamo errors and the process aborted. The error is happening when runnin…
-
# Prerequisites
```python
llm = Llama(
model_path="/home/axyo/dev/LLM/models/Meta-Llama-3-8B-Instruct-GGUF-v2/Meta-Llama-3-8B-Instruct-v2.Q5_0.gguf",
n_gpu_layers=-1,
seed=8,
n…
-
Hi Guys, I am trying to LLM guard in our group enterprise's solution. The problem we are facing we want to make different paramters of input scanners to changed as per user request dynamically, one wa…
-
I want to add Nemo Guardrail as a layer on top of vLLM hosted LLM. That means, I need to replace openai model with my vLLM hosted LLM.
One approahc seems to be to update the config.yml, but is it po…
-
I was reading my friends [blog post](https://transitivebullsh.it/agentic-spectrum) and was inspired to think about AI systems in a more structured way. They have these AI "level" designations.
It wo…
-
### System Info
GPU: H20 server
CUDA Version: 12.5
Driver: 555.42.02
TRTLLM Commit: 2d234357c6e69fa514f6e9b4d4a5ad3bc431c4a6
built from source on linux
### Who can help?
_No response_
…
-
**Describe the bug**
InvalidParamException exception thrown since presidio analyzer is in bad state
**To Reproduce**
Steps to reproduce the behavior:
1. Install LLM Guard 0.3.13
2. With python …
-
- [ ] [argilla/magpie-ultra-v0.1 · Datasets at Hugging Face](https://huggingface.co/datasets/argilla/magpie-ultra-v0.1)
# Dataset Card for magpie-ultra-v0.1
## Dataset Summary
`magpie-ultra` is a s…