search

deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
https://vigil.deadbits.ai/
Apache License 2.0
270 stars 32 forks source link

Data loader using existing setup functions #60

Closed deadbits closed 7 months ago

deadbits commented 7 months ago

The main loader.py script was re-implementing too much code related to the config parsing and vector database setup. I've created a new vigil/core/loader.py class to handle the dataset loading logic, and the main script now uses the vigil/vigil.py functions for setting up the vector database from the config.

Also added a new model to the schema to represent dataset rows