search

yaroslavyaroslav / OpenAI-sublime-text

First class Sublime Text AI assistant with GPT-o1 and ollama support!
MIT License
173 stars 13 forks source link

Vision feature #33

Closed yaroslavyaroslav closed 1 day ago

yaroslavyaroslav commented 11 months ago

https://platform.openai.com/docs/guides/vision To groom

yaroslavyaroslav commented 7 months ago

As I figured out recently in an alike project OpenAI picture handling feature is required an external file hosting with both https and direct links support.

So yet I dunno how to make it client side at all, nothing to say about how to make it with low effort.

yaroslavyaroslav commented 5 months ago

On a second look I found that it actually handles the serverless way to pass images there (by base64 encoding them) https://platform.openai.com/docs/guides/vision/uploading-base-64-encoded-images

So now this is quite straightforward, while not the highest priority.

UPD: There's an upcoming release around the corner which would present an option to send the whole file from within active sheets in a given group. Currently it's using for a text only message sending, but this approach could be expanded to encode a view's content to a base64 and send it that way further.

yaroslavyaroslav commented 1 day ago

Implemented for particular models