neuralmagic / guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Apache License 2.0
128 stars 7 forks source link

🔨 `guidellm` build script is added #15

Closed parfeniukink closed 1 month ago

parfeniukink commented 1 month ago

The build command is added and tested locally. Can't add it to the CI process - don't have enough rights to manage github organization