What is the latest triton server release version available for jetpack 4.6.4

triton-inference-server / server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

BSD 3-Clause "New" or "Revised" License

8.29k stars 1.48k forks source link

Open HuseyinSaidKoca opened 1 month ago

HuseyinSaidKoca commented 1 month ago

I know that 2.18+ supports pytorch and we want to use that. jetson nano have jetpack 4.6.4 latest version. can this version install triton 2.20

we need pytorch and python backend supports

rsemihkoca commented 1 month ago

@krishung5 do you have any info ? Thank you in advance

krishung5 commented 1 month ago

@nv-kmcgill53 Do you know where we can find the support matrix of Triton and jetpack version?

rsemihkoca commented 1 month ago

Currently we used 2.19 because 2.20 required cuda 11 and it does not install on jetson nano