search

deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
https://vigil.deadbits.ai/
Apache License 2.0
270 stars 32 forks source link

Add elapsed time to response #39

Closed deadbits closed 8 months ago

deadbits commented 9 months ago

Since this app is meant to be placed between an LLM and the user, keeping response times fast is important. I want to add an elapsed_time field to scan responses so users can see exactly how long a scan takes.

deadbits commented 8 months ago

Addressed in https://github.com/deadbits/vigil-llm/issues/39 elapsed time was added to both /analyze endpoints, rounded to 6 ms