search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
74 stars 26 forks source link

TGI 1.4.0 #52

Closed timelfrink closed 7 months ago

timelfrink commented 7 months ago

Issue #, if available:

Description of changes: Adding TGI 1.4.0

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

evakravi commented 7 months ago

Official TGI 1.4.0 PR: https://github.com/awslabs/llm-hosting-container/pull/54