Can't send images to be analyzed to litellm models - Githubissues

ai-cfia / louis

Internal User-friendly WebUI for LLMs (Forked from open-webui)

MIT License

1 stars 0 forks source link

Can't send images to be analyzed to litellm models #6

Open SonOfLope opened 2 months ago

SonOfLope commented 2 months ago

When configuring a litellm that can analyze images like 'gemini-1.5-pro' or 'gemini-pro-vision' and send it an image file to be analyzed, it gets stuck into a loop trying to give an answer. Ultimately I have to restart de pod instance since the website becomes unresponsive.

Looking into it, the image file is being sent by pointing to a url : https://github.com/ai-cfia/louis/blob/c9589e21181d97d7cab2937e69a345ba60e4fe71/src/routes/(app)/%2Bpage.svelte#L574 I dont know if its related to hosting louis internally since it works when testing locally with the snippet code : https://litellm.vercel.app/docs/providers/gemini#sample-usage-1

SonOfLope commented 1 month ago

related issue explaining that this is a known limitation : https://github.com/open-webui/open-webui/discussions/1298