search

triton-inference-server / model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.
Apache License 2.0
423 stars 74 forks source link

custom samples #875

Open riyajatar37003 opened 4 months ago

riyajatar37003 commented 4 months ago

Hi , is there any way we can pass our own custom test samples to model analyser during profiling.

tgerdesnv commented 4 months ago

Model Analyzer uses Perf Analyzer under the hood

It supports passing in custom input data

You can pass in perf-analyzer flags using the perf_analyzer_flags section of the config.yml file.

A little more info here