search

mrwadams / attackgen

AttackGen is a cybersecurity incident response testing tool that leverages the power of large language models and the comprehensive MITRE ATT&CK framework. The tool generates tailored incident response scenarios based on user-selected threat actor groups and your organisation's details.
GNU General Public License v3.0
971 stars 132 forks source link

how to support local ollama? #6

Closed langyajiekou closed 7 months ago

langyajiekou commented 7 months ago

how to support local ollama?

mrwadams commented 7 months ago

Thanks for the suggestion, that would be a great feature.

Give me a couple of days... 🙂

mrwadams commented 7 months ago

@langyajiekou I've now added support for local models that are accessible via the API endpoint that Ollama exposes. Please test it out and let me know if you run into any issues.

The quality of the outputs is of course highly dependent on the capability of the local model, but I've tested Mistral 7B and Gemma and both generated reasonable scenarios.

📝 A note for anyone reading this - Ollama is only supported when it and the Streamlit app are running on the same local machine.