awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
75 stars 32 forks source link

chore: add TGI 1.4.5 image #63

Closed whittech1 closed 6 months ago

whittech1 commented 6 months ago

Need to release TGI 1.4.5 (original Dockerfile).

Note that no changes were made in this original Dockerfile since the v1.4.1 release. Also note that the 1.4.2 Dockerfile in the awslabs/llm-hosting-container repository does not exactly match the one mentioned previously in the huggingface/text-generation-inference repository.

Assuming this is by design, I:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

haixiw commented 6 months ago

I am assuming we don't have a big diff in THIRD_PARTY_LICENSE compared to the previous version right?

amzn-choeric commented 6 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

philschmid commented 6 months ago

I am assuming we don't have a big diff in THIRD_PARTY_LICENSE compared to the previous version right?

No it's the same container file on TGI code changed

amzn-choeric commented 6 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

amzn-choeric commented 6 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

amzn-choeric commented 6 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

amzn-choeric commented 6 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

amzn-choeric commented 6 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

amzn-choeric commented 6 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository