neuralmagic / guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Apache License 2.0
160 stars 11 forks source link

add small fixes #4

Closed DaltheCow closed 4 months ago

DaltheCow commented 4 months ago

Mark asked for some base fixes to be added separately from my other PR so it could be added in faster