search

Azure / PyRIT

The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their generative AI systems.
MIT License
1.92k stars 369 forks source link

Running multiple attacks simultaneously #439

Open wadhwasahil opened 1 month ago

wadhwasahil commented 1 month ago

I am a looking for a way to run multiple attacks like Crescendo, PAIR, TAP etc together either sequentially or in parallel, so that I don't have to manually run them one by one.

romanlutz commented 1 month ago

Can you elaborate on what this should look like in your opinion?

You can certainly put together a notebook where you run everything back-to-back.

We've seen some obstacles to running too much in parallel depending on what endpoints you have at your disposal. Many can't handle high volumes of requests.

That said, this is obviously something we think about often and will at some point address. Some input on your requirements would help 🙂