search

TensorOpsAI / LLMstudio

Framework to bring LLM applications to production
https://tensorops.ai
Mozilla Public License 2.0
252 stars 27 forks source link

Explore/azure oai vision #126

Closed diogoazevedo15 closed 4 weeks ago

diogoazevedo15 commented 1 month ago

Summary

Updated the method input_to_string in provider.py to ensure compatibility with vision models.

input_to_string:

  1. Now appends text from messages containing images.
  2. Also adds the base64 string to the token count.

To be discussed: Should we include the base64 string in the token count?