Hello, I set up this project on my computer, and it works. However, it is rather slow and when starting through the cli it says that inference is using the CPU.
Is there something I can change to make inference GPU-dependent instead for the sake of performance?
Hello, I set up this project on my computer, and it works. However, it is rather slow and when starting through the cli it says that inference is using the CPU.
Is there something I can change to make inference GPU-dependent instead for the sake of performance?