neuralmagic / guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Apache License 2.0
159 stars 11 forks source link

Add Report Generation and Configuration Improvements for GuideLLM #24

Closed markurtz closed 3 months ago

markurtz commented 3 months ago

Summary

Introduces a report file generation feature for GuideLLM and fixes the configuration functionality. Once the frontend is live, we will add the report generation functionality to the CLI and add integration and end to end tests

Details

Test Plan