search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
74 stars 26 forks source link

chore: add optimum version 0.0.17 #49

Closed dacorvo closed 7 months ago

dacorvo commented 7 months ago

Description of changes:

Add docker image for Neuron X TGI based on optimum-neuron == 0.0.17.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

amzn-choeric commented 7 months ago

We have merge this with https://github.com/awslabs/llm-hosting-container/pull/50.

Release is completed.