search

security-alliance / frameworks

Official repository for the Security Frameworks by SEAL. Currently under development, not a release.
https://frameworks.securityalliance.org
17 stars 5 forks source link

Consdier adding an AI chatbot, trained with frameworks, to provide suggestions #62

Open mattaereal opened 2 months ago

mattaereal commented 2 months ago

What content are you looking to add?

A simple AI chatbot, trained with frameworks, to help people access the information better.

Why do you think it is important?

Despite having tags, or filtering by roles, it could be a good idea to explore better ways to instruct or guide users to much more digested information.

Can you cite resources where to base the content from?

It's not exactly content, more like an improvement to the UI/UX.

Robert-MacWha commented 1 month ago

Are you after better search or direct instruction?

For better search — just incorporating fuzzy search could work to improve UX (thought it seems like mdbook may not support this yet?).

I would worry about resource requirements for running a LLM. I don't think any of the local ones are small enough to fit in a browser while being actually useful, and renting out AWS to run our own fine-tuned model seems like it would be costly.

mattaereal commented 1 month ago

Maybe we can postpone this a few months or years until a small LLM can be implemented cheap and easily. Fuzzy search would be ideal, not a replacement for this but a great idea.

I haven't been able to find something quick to implement yet