search

microsoft / semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps
https://aka.ms/semantic-kernel
MIT License
22.13k stars 3.3k forks source link

.Net: New Feature: MistralAI - Multi-Modal Chatcompletion Support #9806

Open tntwist opened 4 days ago

tntwist commented 4 days ago

name: MistralAI - Multi-Modal Chatcompletion Support about: Add support for multimodal chat completion for the MistralAI connector.

Hey there,

i played a bit with the .Net Connector for MistralAI and noticed that the connector does not support multi modal chat completion. It would be nice to have this be supported by the connector.

Best regards

evchaki commented 4 days ago

@tntwist - thanks for bringing this up. Do you need this ASAP for a project, or more to just try it out? @markwallace-microsoft - can you take a look.

tntwist commented 4 days ago

@evchaki - thanks for you fast response. I plan to use sk in a project that requires to use Mistral with multi modal chat completion. So ASAP would be great. ❤ Also implementation is nearly finished for the use case in my project. Just stumbled on this when testing.

markwallace-microsoft commented 1 day ago

Hi @tntwist can you share which multi-modal scenario you are trying?

tntwist commented 1 day ago

Image description. The user adds some images and asks to describe the images.

So the issue is that the semantic kernal connector is not sending the images to mistral.