neuralmagic / guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Apache License 2.0
158 stars 11 forks source link

[Dataset]: Iterate through benchmark dataset once #48

Closed parfeniukink closed 4 weeks ago

parfeniukink commented 2 months ago

issue link: https://github.com/neuralmagic/guidellm/issues/44

Summary:

parfeniukink commented 2 months ago

@philschmid Hey there. Could you install the version of the branch parfeniukink/issues/44 and tell me if works for you?

philschmid commented 4 weeks ago

Hey Guys, any idea on when we could get this merged?