deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
https://vigil.deadbits.ai/
Apache License 2.0
304 stars 35 forks source link

Switch API server to use FastAPI #45

Open deadbits opened 11 months ago

deadbits commented 11 months ago

Migrate the API server use FastAPI instead of Flask. I'm more familiar with Flask but after reading about fastapi a bit, it seems preferable for APIs. The Streamlit UI won't be affected since that just hits the API (I also want to move away from Streamlit, but that's a different ticket).

https://fastapi.tiangolo.com/features/#short