search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
74 stars 26 forks source link

ADD TGI 1.4.0 #53

Closed philschmid closed 7 months ago

philschmid commented 7 months ago

We released 1.4.0 last week, which also has support for the "Messages API" which is compatible with OpenAIs api -> https://huggingface.co/docs/text-generation-inference/messages_api

evakravi commented 7 months ago

Official TGI 1.4.0 PR: https://github.com/awslabs/llm-hosting-container/pull/54