Add optimum NeuronX TGI 0.0.20 image - Githubissues

awslabs / llm-hosting-container

Large Language Model Hosting Container

Apache License 2.0

74 stars 26 forks source link

Add optimum NeuronX TGI 0.0.20 image #62

Closed dacorvo closed 5 months ago

dacorvo commented 6 months ago

Description of changes:

This adds the Neuron X TGI 0.0.20 image

amzn-choeric commented 5 months ago

AWS CodeBuild CI Report

CodeBuild project: tgi-pr-gpu
Commit ID: 4cc34f5f03454a556e13e951f44d385004cf0e46
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

amzn-choeric commented 5 months ago

AWS CodeBuild CI Report

CodeBuild project: tgi-pr-inf2
Commit ID: 4cc34f5f03454a556e13e951f44d385004cf0e46
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository