triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
527 stars 225 forks source link

Fix hardcoded profile export file name usage #608

Closed matthewkotila closed 3 months ago

matthewkotila commented 3 months ago

Currently, if someone calls GenAI-Perf and sets their own profile export file path/name, e.g.

genai-perf --profile-export-file my_profile_export.json ...

They will run into this error:

FileNotFoundError: [Errno 2] No such file or directory: 'profile_export.json' -> 'artifacts/data/profile_export.json' 

Because of these lines:

https://github.com/triton-inference-server/client/blob/f0ad3617b1775cc92fefa83a22d36b06d28a9adf/src/c%2B%2B/perf_analyzer/genai-perf/genai_perf/main.py#L123-L129

Those lines need to be updated to dynamically use whatever the profile export file path is set to, possibly different from the default (if the user specifies it)