search

microsoftfeedback / aci-issues

Issue reporting and tracking for the Azure Container Instances service
Creative Commons Attribution 4.0 International
7 stars 0 forks source link

Support for nvidia Triton Inference Server in ACI #42

Open tom-r-o opened 3 years ago

tom-r-o commented 3 years ago

Running Triton on ACI (with a V100 GPU) yields errors in Triton:

ERROR: This container was built for NVIDIA Driver Release 450.51 or later, but
       version 410.104 was detected and compatibility mode is UNAVAILABLE.

       [[CUDA Driver UNAVAILABLE (cuInit(0) returned 803)]]

Running the same Triton image on an Azure VM with a V100 GPU from nvidia's image does not cause the error. I'm guessing this is related to some missing drivers.

Triton's quickstart guide is available here