search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
75 stars 32 forks source link

Please update to 0.8.2 to fix multiple bugs #11

Closed austinmw closed 1 year ago

austinmw commented 1 year ago

Hi, v0.8.2 fixes multiple issues compared to 0.6, including enabling Falcon model deployment

lanking520 commented 1 year ago

Currently it is upgraded, we will publish to Deep Learning Container soon

xyang16 commented 1 year ago

TGI 0.8.2 was released. See the DLC page: https://github.com/aws/deep-learning-containers/blob/master/available_images.md#huggingface-text-generation-inference-containers.