search

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
527 stars 225 forks source link

Add guide on using files generated by GenAi-Perf #600

Closed dyastremsky closed 3 months ago

dyastremsky commented 3 months ago

This pull request adds a document outlining how to use the files generated by GenAi-Perf. The aim of the guide is to be concise and clear, providing a basic starting point for reading and using these files.

dyastremsky commented 3 months ago

@debermudez, do you know if profile_json.json and profile_export.json redundant? I don't see in the code were profile_json.json gets generated and used. I don't know when it started getting generated. They look similar but they are not the same.

debermudez commented 3 months ago

generated and used. I don't know when it started getting generated. They look similar but they are not the same.

profile_json.json is a typo i introduced. it is profile_export.json. It should be fixed in the main branch and the release.

dyastremsky commented 3 months ago

generated and used. I don't know when it started getting generated. They look similar but they are not the same.

profile_json.json is a typo i introduced. it is profile_export.json. It should be fixed in the main branch and the release.

Thanks for clarifying! Removed it.