deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
https://vigil.deadbits.ai/
Apache License 2.0
270 stars 32 forks source link

VectorDB dupes #38

Closed deadbits closed 9 months ago

deadbits commented 9 months ago

Ignore duplicate vector db text matches. When auto_add is enabled for the vector db, the same prompt can be added to the db multiple times (this should probably be fixed on its own too). This addresses that but making sure only unique text matches are added to the results.