Guard GenAI-Perf plot generation

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

BSD 3-Clause "New" or "Revised" License

551 stars 227 forks source link

Closed dyastremsky closed 3 months ago

dyastremsky commented 3 months ago

This pull request:

Prevents the plots directory from being created when --generate-plots is not called
Protects the embeddings/rankings endpoints from using the --generate-plots option until it is supported
Adds testing for parser errors (--streaming/--generate-plots)

Rankings can no longer be called with --generate-plots:

Embeddings can no longer be called with --generate-plots:

Plots directory not created without --generate-plots:

nv-hwoo commented 3 months ago

saw this late but thanks for catching this!