leondz / garak

LLM vulnerability scanner
https://discord.gg/uVch4puUCs
Apache License 2.0
1.04k stars 121 forks source link

generator: phi-3 multimodal nim #691

Open leondz opened 1 month ago

leondz commented 1 month ago

add new text+image -> text model

intro: https://azure.microsoft.com/en-us/blog/introducing-phi-3-redefining-whats-possible-with-slms/

api endpoint: https://build.nvidia.com/explore/discover#phi-3-vision-128k-instruct

garak integration guide: https://reference.garak.ai/en/latest/contributing.generator.html