danny-avila / LibreChat

Enhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, Groq, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Vertex AI, Gemini, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development
https://librechat.ai/
MIT License
15.56k stars 2.58k forks source link

Enhancement: Link to image (image_url) for vision-capable endpoints rather than b64 #2774

Open iGerman00 opened 2 months ago

iGerman00 commented 2 months ago

What features would you like to see added?

A configuration option per API endpoint to use image_url with an actual URL instead of base64.

More details

Right now, to the best of my knowledge, any uploaded images are sent as b64 to the API, always. This is fine for most APIs, but some might require an image link instead. Given that the images are already uploaded and are accessible over /images/*, I think a configuration option or two (you might need to specify a base public URL) would be a good addition in the custom endpoints' configuration.

Which components are impacted by your request?

Endpoints

Pictures

No response

Code of Conduct

danny-avila commented 1 month ago

Should be simple enough to expose and send a URL instead, but this should be configured by admin setting, as not all setups will expose their service or assets to the internet.