NVIDIA-AI-IOT / tao-toolkit-triton-apps

Sample app code for deploying TAO Toolkit trained models to Triton
MIT License
84 stars 30 forks source link

Deployment to Jetson #23

Open robbyfrt opened 1 year ago

robbyfrt commented 1 year ago

We would like to deploy the pose classification model to our Jetson Orin devices.

We have been trying to generate the corresponding Dokerfile for the Tritonserver without much success.

Is there an easy way to host the Pose Classification model on a Jetson device in order to serve a deepstream app that uses pose classification? Is this even possible? Any information regrding this would be appreciated.

Pattform: Orin AGX 32GB, Jetpack 5.1, Deepstream 6.2 using a docker image (deepstream-l4t:6.2-triton) to run the client.