-
I've discovered that there is something wrong with 2 attack enhancement modes **when run with async_mode=False**.
The two modes that are failing are **JAILBREAK_CRESCENDO** and **MATH_PROBLEM**. The…
-
**Describe the bug**
Remote generation via the `api.promptfoo.dev` backend cannot be switched for adversarial prompts generation.
**To Reproduce**
Even if the custom adversarial provider is confi…
-
During RvB with phishing exercise
Red teaming: https://github.com/joshnguyen08/cybersecurity-homelab/blob/main/red-team/RvB-Phishing%20(FINISHED)
Blue teaming: https://github.com/joshnguyen08/…
-
I'm encountering an error when trying to run the red teaming feature of Promptfoo with specific model IDs. The error message indicates that the model does not exist or access is denied, even though I’…
-
#### **Is your feature request related to a problem? Please describe.**
LLMs can output ANSI escape codes that manipulate terminals, such as moving cursors, hiding text, or even executing commands. …
-
We recently discovered https://safetyprompts.com/, which has so many datasets!
We need help going through the website and creating a list of relevant datasets. A relevant dataset is one which conta…
-
### A description of the work
### User story
As a tech practitioner, I'd like to see a new method card added on red teaming so that I have new tools/practices that help safeguard new products/servic…
-
[2024-08-24 10:21:20,122] [INFO] [moonshot.integrations.web_api.app]: Request origin: None
2024-08-24 10:21:20,134 [INFO][runner.py::run_red_teaming(476)] [Runner] malicious-test-1 - Running red team…
-
[What is red teaming?](https://en.wikipedia.org/wiki/Red_team)
[Link to PDF](https://github.com/user-attachments/files/15989376/CSUpwardMobility.36775.pdf)
-
#### Is your feature request related to a problem? Please describe.
We have a few downloaded Hugging Face models and we would like to use PyRIT for AI red teaming. I didn;t find any Prompt Target f…