search

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
527 stars 225 forks source link

Generate plot configurations for plot manager #632

Closed nv-hwoo closed 2 months ago

nv-hwoo commented 2 months ago

The ProfileRunData contains all the data/info needed for each profile run, and PlotConfig contains all the info needed for plotting, including the profile run data.

When the user runs 

genai-perf compare --files profile1.json profile2.json

we will

  1. Create an initial yaml config file for the default plots (e.g. create_init_yaml_config(...))
  2. Use the yaml config to generate plot config objects (e.g. generate_configs())

When the user runs

genai-perf compare --config config.yaml

we will

  1. (skip the yaml config generation since user already provided one)
  2. Use the yaml config to generate plot config objects (e.g. generate_configs())