leondz / garak

LLM vulnerability scanner
https://discord.gg/uVch4puUCs
Apache License 2.0
1.03k stars 121 forks source link

additional `coherechat` generator to reflect `/chat` endpoint #710

Closed GangGreenTemperTatum closed 4 weeks ago

GangGreenTemperTatum commented 1 month ago

hey! 🙂 thanks so much for garak first of all 👏🏼

the Cohere REST API has moved to /chat which is currently limited to one generation and therefore requires multiple POSTs

https://docs.cohere.com/docs/chat-api https://docs.cohere.com/reference/chat

from the original /generate documented here which is currently in use from the current cohere.py generator

i think we should have an additional (outside of the rest generator) generator for coherechat.py which i am proposing in #705

i wanted to get this on the board, predominately for visibility and preventing DUP efforts, in retrospect i should have started with an issue first (melt) and therefore started with this and linked to this PR - hope that's OK!

raising the issue against the board for vis etc :)

GangGreenTemperTatum commented 4 weeks ago

https://github.com/leondz/garak/pull/705#issuecomment-2142811509