deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
https://vigil.deadbits.ai/
Apache License 2.0
270 stars 32 forks source link

Consider OpenAI API drop-in replacement #47

Closed deadbits closed 7 months ago

deadbits commented 8 months ago

It should be easier to use Vigil in a more passive manner where all LLM requests/prompts and responses pass through the respective scanners, instead of needing to submit prompts/responses to the Vigil API server. Maybe build it like a drop-in replacement for OpenAI's API schema...