openedtech / edubot

GNU General Public License v3.0
16 stars 5 forks source link

EduBit needs to understand its own images better #22

Closed moodler closed 1 year ago

moodler commented 1 year ago
image
exciteabletom commented 1 year ago

image Image -> Text API got: "a large dog wearing a turban with a dog behind it in the mountain" for this image

exciteabletom commented 1 year ago

I've improved it for most cases, but the image to text tech isn't great.

It is sometimes misinterpreting the images, but I don't think there is much we can do about that.

Edubot is now informed of both it's own interpretation of the image, as well as the prompt that generated the image. So it will prefer the prompt info and only use it's own interpretation for details not included in the prompt