search

Azure / PyRIT

The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their generative AI systems.
MIT License
1.91k stars 366 forks source link

FEAT Add Ethical Red Team Dataset #417

Open nina-msft opened 1 month ago

nina-msft commented 1 month ago

Describe the solution you'd like

This dataset should be available within PyRIT: https://huggingface.co/datasets/srushtisingh/Ethical_redteam (prompt column)

Additional context

There are examples of how PyRIT interacts with other datasets here: https://github.com/search?q=repo%3AAzure%2FPyRIT%20%23%20The%20dataset%20sources%20can%20be%20found%20at%3A&type=code

[[Content Warning: Prompts are aimed at provoking the model, and may contain offensive content.]] Additional Disclaimer: Given the content of these prompts, keep in mind that you may want to check with your relevant legal department before trying them against LLMs.

radhika-singh-10 commented 1 month ago

Hi, I'm looking forward to work on this issue.