epam / ai-dial-adapter-openai

The project implements AI DIAL API for language models from Azure OpenAI
https://epam-rail.com
Apache License 2.0
7 stars 3 forks source link

GPT4 Vision: add warning to user if the first user message doesn't contain any images #94

Closed adubovik closed 1 day ago

adubovik commented 3 months ago

It seems like GPT4V is getting stuck in a text-only mode when the first user message doesn't contain any images attached to it. Meaning it refuses to recognize images in follow-up questions.

This is a GPT4V feature which we could do nothing about.

However, for the DIAL Chat user it may be quite confusing. We may add a warning stage saying something like this:

Warning:
Keep in mind, that GTP4 Vision model expects image(s) in a first user message. 
Otherwise, it's going to work as a text-only model.

in order to highlight this GPT4V feature.

adubovik commented 1 day ago

Closed as not reproducible anymore.