johnolafenwa / DeepStack

The World's Leading Cross Platform AI Engine for Edge Devices
Apache License 2.0
675 stars 105 forks source link

Process delays Windows GPU version #52

Open Tinbum1 opened 3 years ago

Tinbum1 commented 3 years ago

If DeepStack hasn't processed an image for a few minutes the next image it receives takes longer to process.

/v1/vision/detection


v1/backup

v1/restore [GIN] 2020/12/25 - 10:03:04 |←[97;42m 200 ←[0m| 1.2656734s | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:03:05 |←[97;42m 200 ←[0m| 109.999ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:03:07 |←[97;42m 200 ←[0m| 118.0029ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:03:09 |←[97;42m 200 ←[0m| 112.0003ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:03:11 |←[97;42m 200 ←[0m| 118.0003ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:33:43 |←[97;42m 200 ←[0m| 447.0139ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:42:44 |←[97;42m 200 ←[0m| 405.532ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:50:36 |←[97;42m 200 ←[0m| 430.1112ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:50:37 |←[97;42m 200 ←[0m| 118.0717ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection [GIN] 2020/12/25 - 10:50:41 |←[97;42m 200 ←[0m| 208.5627ms | 127.0.0.1 |←[97;46m POST ←[0m /v1/vision/detection

johnolafenwa commented 3 years ago

Hello @Tinbum1 , thanks for sharing this. This behaviour is known. We are working on making the performance better in newer versions.