I'm trying to trace the model in order to do inference in c++ but I've encountered problems when running on cuda.
When doing inference with a CPU model it works fine, but when exporting a cuda model, i get the following error.
Was anyone able to do inference with cuda in c++?
Any response will be highly appreciated.
I'm trying to trace the model in order to do inference in c++ but I've encountered problems when running on cuda. When doing inference with a CPU model it works fine, but when exporting a cuda model, i get the following error.
Was anyone able to do inference with cuda in c++? Any response will be highly appreciated.