search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
75 stars 32 forks source link

Add Neuronx TGI 0.0.23 #79

Closed dacorvo closed 4 months ago

dacorvo commented 4 months ago

Description of changes:

Add NeuronX TGI image 0.0.23.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

jimburtoft commented 4 months ago

There may be another reason to hold it. https://github.com/huggingface/optimum-neuron/issues/617