search

triton-inference-server / model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.
Apache License 2.0
422 stars 74 forks source link

Dose model analyzer tool support Jetson nano? #123

Open liwenhust8282 opened 3 years ago

liwenhust8282 commented 3 years ago

the model analyzer is amazing tool. it is very useful when we do some model performance analysis. As I am deploying triton inference server on Jetson nano and window 10, So I try to install it on my jetson nano board. and it always failed. So I want to check if it support Jetson nano? and if it support window 10? Thanks a lot in advance!

Tabrizian commented 3 years ago

@liwenhust8282 Glad that you found the tool useful! Unfortunately, it currently only supports Linux and does not work on Jetson or Windows 10.

bnabis93 commented 2 years ago

@Tabrizian I also can't install it on my Jetson Xavier device. (branch r22.03)

Hasn't it been added yet? I want to know this feature was added. Or I want to know the progress.

Thank you.

Tabrizian commented 2 years ago

Jetson support for Model Analyzer has not been added yet. We will update this issue whenever the support has been added.