mrwadams / stride-gpt

An AI-powered threat modeling tool that leverages OpenAI's GPT models to generate threat models for a given application based on the STRIDE methodology.
https://stridegpt.streamlit.app
MIT License
335 stars 100 forks source link

Add local LLM hosting option #25

Open willasaywhat opened 4 weeks ago

willasaywhat commented 4 weeks ago

I forked the repository and added support for a custom OpenAI compatible endpoint using LM Studio. This allows you to run a local LLM and generate threat modeling artifacts through the tool without sharing data with a 3rd party. Happy to put in a pull request, but still testing on my end.

Mistral 7B performs relatively well here, but I am seeing some issues with the mermaid output not being escaped properly and the Gherkin test case generation is failing on return. Not sure why, but otherwise... it works pretty great.