search

Azure / PyRIT

The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their generative AI systems.
MIT License
1.91k stars 366 forks source link

FEAT add support for local model checkpoints in HF target #572

Open romanlutz opened 6 hours ago

romanlutz commented 6 hours ago

Is your feature request related to a problem? Please describe.

Our HF target can download and run models from HuggingFace. However, if you have a model checkpoint locally in HF format, you can't load it (yet!).

Describe the solution you'd like

Instead of providing a model name we should perhaps also have the option of providing a model directory instead and just load it from there.

CC @KutalVolkan [just FYI since you created the original target]

KutalVolkan commented 5 hours ago

Hello Roman,

I will take care of it :)