generator: PRIVATE GPT / FastAPI + OpenAI

leondz / garak

LLM vulnerability scanner

https://discord.gg/uVch4puUCs

Apache License 2.0

1.26k stars 145 forks source link

generator: PRIVATE GPT / FastAPI + OpenAI #532

Closed secure1-code closed 5 months ago

secure1-code commented 6 months ago

I have installed GARAK tool on kali linux. I want to scan "Private GPT" (LLM Model), which is locally installed on my system and running on local host. Is it possible to scan "Private GPT" for security vulnerabilities using GARAK.

Link for Private GPT: github.com/imartinez/privateGPT?tab=readme-ov-file

I would really appreciate if anyone can guide/help me. Thanks

erickgalinkin commented 5 months ago

This should work via the REST generator -- you just need to specify the calling convention and point it to the location of your FastAPI endpoint.