ollama: add support for moderation model - Githubissues

redpanda-data / connect

Fancy stream processing made operationally mundane

https://docs.redpanda.com/redpanda-connect/about/

8.14k stars 840 forks source link

ollama: add support for moderation model #3028

Open rockwotj opened 20 hours ago

rockwotj commented 20 hours ago

ollama: support saving the prompt as metadata
ollama: add ollama_moderation for llama-guard and shieldgemma

This allows us to classify LLM responses for safety.