Closed RiverDong closed 1 year ago
Hi I am wondering if we can use GPU to accelerate the inference time? Right now it's somewhat slow using CPU. Thank you
It should default to using GPU if available. How are you running this currently?
Closing for now. Please re-open the issue if you're still having trouble using the GPU.
Hi I am wondering if we can use GPU to accelerate the inference time? Right now it's somewhat slow using CPU. Thank you