search

JoshuaC215 / agent-service-toolkit

Full toolkit for running an AI agent service built with LangGraph, FastAPI and Streamlit
https://agent-service-toolkit.streamlit.app
MIT License
247 stars 40 forks source link

Fully integrate LlamaGuard for content moderation #23

Closed JoshuaC215 closed 2 weeks ago

JoshuaC215 commented 2 weeks ago

LlamaGuard is fully working now with good response times from Groq in my testing.

This PR cleans up the LlamaGuard implementation and integrates it into the research assistant. Moderation is performed both on the incoming message from the user and the outgoing message from the LLM.