search

bentoml / OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
9.7k stars 616 forks source link

fix(compat): use annotated type from `typing_compat` #943

Closed rudeigerc closed 5 months ago

rudeigerc commented 5 months ago

Use annotated type from typing_compat instead for compatibility with Python 3.8.

aarnphm commented 5 months ago

Oh I forgot to mention, I will drop 3.8 support for 0.5 :)