search

jswope00 / AI-MicroApps

A flexible template for creating AI-powered educational apps
MIT License
8 stars 54 forks source link

The App Can't actually read Image URLs #4

Open jswope00 opened 1 month ago

jswope00 commented 1 month ago

Turns out, telling the AI "Please write alt text for the following image: [List of Image URLs]" does not work. GPT models, at least, won't access those URLs and view the image. Sometimes they pretend that they can by reading the URL of the image, but they actually aren't.

To fix this, we'll need to find some way to extricate image URLs from text fields (I don't know if we'll need to create some special flag for these kinds of text fields where we expect image URL inputs) and pass them into the API via the AI's approved method for passing in image URLs.

In other words, AI will accept image urls, but not when they are passed in via a text box.

OmarIthawi commented 1 month ago

Hi @jswope00!

You can attach an image, which ChatGPT UI will process. URLs like you said aren't processed.

I'm not sure what's the API equivelant for that in the ChatGPT API.