search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
74 stars 26 forks source link

Add TGI 2.0.2 and TGI NeuronX 0.0.22 #72

Closed Captainia closed 3 months ago

Captainia commented 4 months ago

Issue #, if available:

Description of changes:

Taking over the PR from HF to add 0.0.22 NeuronX TGI and 2.0.2 TGI: https://github.com/awslabs/llm-hosting-container/pull/71

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

amzn-choeric commented 4 months ago

AWS CodeBuild CI Report

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository