Does gonnx supports GPU inference?

AdvancedClimateSystems / gonnx

Run ONNX models using Go

Mozilla Public License 2.0

35 stars 3 forks source link

Does gonnx supports GPU inference? #206

Open deependujha opened 2 weeks ago

deependujha commented 2 weeks ago

As stated in the heading, is there a way to infer model on GPUs or TPUs?

Swopper050 commented 6 days ago

Hi @deependujha , right now it is not supported out of the box in Gonnx. However, I believe that the Tensor package we use does support GPU inference so we will look into building this in the future (or feel free to try yourself).