CodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.
Other
565
stars
135
forks
source link
Coral TPU model change automatically after 120sec #100
[X] Behaviour of one or more Modules [ObjectDetectionCoral]
[ ] Installer
[ ] Runtime [e.g. Python3.7, .NET]
[ ] Module packages [e.g. PyTorch)
[ ] Something else
Describe the bug
I call object detection API with custom model 2 time with +120sec between and the second time, the model used wasn't YOLO but default model.
server log output:
Response rec'd from Object Detection (Coral) command 'custom' (...6e9f4a) ['Found car, person, car'] took 280ms
11:48:39:objectdetection_coral_adapter.py: WARNING:root:No work in 120.0 seconds, watchdog shutting down TPUs.
11:49:47:Response rec'd from Object Detection (Coral) command 'custom' (...8c1757) ['No objects found'] took 2751ms
11:50:02:objectdetection_coral_adapter.py: Object Detection (Coral) started.
11:50:02:objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
11:50:02:objectdetection_coral_adapter.py: No interpreter found. Recreating.
11:50:02:objectdetection_coral_adapter.py: Model change detected. Forcing model reload.
11:50:02:objectdetection_coral_adapter.py: Timeout connecting to the server
As you can see, first time the model detect person car etc... and second time (same query) nothing found and the model was changed.
Expected behavior
Keep the model configured on the start of the module.
Your System (please complete the following information):
Area of Concern
Describe the bug I call object detection API with custom model 2 time with +120sec between and the second time, the model used wasn't YOLO but default model.
API called: http://XXX:32168/v1/vision/custom/YOLOv5
server log output: Response rec'd from Object Detection (Coral) command 'custom' (...6e9f4a) ['Found car, person, car'] took 280ms 11:48:39:objectdetection_coral_adapter.py: WARNING:root:No work in 120.0 seconds, watchdog shutting down TPUs. 11:49:47:Response rec'd from Object Detection (Coral) command 'custom' (...8c1757) ['No objects found'] took 2751ms 11:50:02:objectdetection_coral_adapter.py: Object Detection (Coral) started. 11:50:02:objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection 11:50:02:objectdetection_coral_adapter.py: No interpreter found. Recreating. 11:50:02:objectdetection_coral_adapter.py: Model change detected. Forcing model reload. 11:50:02:objectdetection_coral_adapter.py: Timeout connecting to the server
As you can see, first time the model detect person car etc... and second time (same query) nothing found and the model was changed.
Expected behavior Keep the model configured on the start of the module.
Your System (please complete the following information):