johnolafenwa / DeepStack

The World's Leading Cross Platform AI Engine for Edge Devices
Apache License 2.0
675 stars 105 forks source link

DeepStack Windows Beta 2 - GPU version is CPU #62

Closed VorlonCD closed 3 years ago

VorlonCD commented 3 years ago

I installed the new GPU beta 2 version and start 4 instances, and send them all a bunch of images to process.

If you watch GPU ram and CPU usage in Task Manager or Process Hacker as they load and run almost no GPU is being used.

But CPU usage spikes like crazy. So I think somehow platform.json > server.go, is not correctly setting the mode?

VorlonCD commented 3 years ago

Process hacker > deepstack.exe > Environment tab shows CUDA_MODE variable is empty.

odd86 commented 3 years ago

+1 After the new release my requests take 4x more time and that is when i dont set mode to high. Now it looks like its just running on the CPU

johnolafenwa commented 3 years ago

Hello @VorlonCD @odd86 This has been fixed, get the latest release here, https://forum.deepstack.cc/t/deepstack-windows-gpu-bug-fix/624?u=john