neuralmagic / guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Apache License 2.0
158 stars 11 forks source link

FIX TGI example #51

Closed philschmid closed 1 month ago

philschmid commented 1 month ago

@eldarkurtic made some error when creating it.