search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
75 stars 32 forks source link

Add optimum-neuron TGI 0.0.19 #60

Closed dacorvo closed 7 months ago

dacorvo commented 8 months ago

Description of changes:

This bumps the NeuronX TGI version to 0.0.19.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

dacorvo commented 8 months ago

@jinyoung-lim I successfully built the image locally, but the CI is failing, and I don't have access to the logs: can you tell me what went wrong and how I can fix it ?

philschmid commented 7 months ago

Lets close this in favor of https://github.com/awslabs/llm-hosting-container/pull/60

dacorvo commented 7 months ago

Lets close this in favor of #60

The reason why I left it was because otherwise 0.0.19 won't ever be built (the latest version is only rebuilt when merging the pull-request).

jinyoung-lim commented 7 months ago

Lets close this in favor of #60

What do you mean? Isn't this #60?