Introduce the `--subset-size` CLI parameter

neuralmagic / guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Apache License 2.0

158 stars 11 forks source link

Introduce the `--subset-size` CLI parameter #64

Open parfeniukink opened 1 week ago

parfeniukink commented 1 week ago

The --subset-size CLI parameter allows to control the subset size inside the TransformersDatasetRequestGenerator class. This is used if you selected transformers type of request generation.

Issue Source