FEAT Add TrustAIRLab/forbidden_question_set Dataset #453 - Githubissues

Azure / PyRIT

The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their generative AI systems.

MIT License

1.91k stars 366 forks source link

FEAT Add TrustAIRLab/forbidden_question_set Dataset #453 #503

Closed ritikakumar0204 closed 3 weeks ago

ritikakumar0204 commented 4 weeks ago

Description

Issue was regarding the availability of TrustAIRLab Forbidden questions dataset from huggingface in PyRIT (https://huggingface.co/datasets/TrustAIRLab/forbidden_question_set) @nina-msft @romanlutz

Created function fetch_forbidden_questions_df in fetch_example_datasets.py module within pyrit/datasets to load dataset and extract harmful questions from the 'questions' column of the dataset.
Made changes in the init.py file

Tests and Documentation

Created testing notebook forbidden_questions_df_testing.ipynb
Added .py file of notebook after conversion using Jupytext

ritikakumar0204 commented 4 weeks ago

@microsoft-github-policy-service agree