search

ZoneMinder / zmeventnotification

Machine Learning powered Secure Websocket & MQTT based ZoneMinder event notification server
408 stars 128 forks source link

Not work with opencv #416

Open sagitt opened 2 years ago

sagitt commented 2 years ago

i upgraded opencv:

root@SERVER:~# sudo pip3 install --upgrade opencv-contrib-python
Requirement already satisfied: opencv-contrib-python in /usr/local/lib/python3.6/dist-packages (4.5.5.64)
Collecting opencv-contrib-python
  Downloading opencv_contrib_python-4.6.0.66-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (67.1 MB)
     |████████████████████████████████| 67.1 MB 3.5 MB/s             
Requirement already satisfied: numpy>=1.13.3 in /usr/local/lib/python3.6/dist-packages (from opencv-contrib-python) (1.19.5)
Installing collected packages: opencv-contrib-python
  Attempting uninstall: opencv-contrib-python
    Found existing installation: opencv-contrib-python 4.5.5.64
    Uninstalling opencv-contrib-python-4.5.5.64:
      Successfully uninstalled opencv-contrib-python-4.5.5.64
Successfully installed opencv-contrib-python-4.6.0.66

And now ZM ES not works. Using last ZM ES version. With my snapshot downgrade, all works fine.

baudneo commented 2 years ago

I have a fix for you. I will edit this message with url in 5 mins. Opencv 4.6+ needs a different way of parsing opencv version for unconnected layers fix

baudneo commented 2 years ago

https://github.com/baudneo/zmes_yolo_fix/blob/master/yolo.py

  1. Find your yolo.py by issuing sudo find /usr -mount -iname 'yolo.py' , output should be something like /usr/local/lib/python3.9/dist-packages/pyzm/ml/yolo.py
  2. wget the above URL: wget https://github.com/baudneo/zmes_yolo_fix/blob/master/yolo.py
  3. copy the new yolo to the existing location and rerun your detections. sudo cp ./yolo.py <output of find command>
baudneo commented 2 years ago

If the find command doesnt work try issuing it to search the root path sudo find / -mount -iname 'yolo.py'

sagitt commented 2 years ago

If the find command doesnt work try issuing it to search the root path sudo find / -mount -iname 'yolo.py'

thank you!! i'll try it

juan11perez commented 2 years ago

@baudneo replaced with your yolo and throws this error

`07/03/22 17:37:24 zmesdetect[405] INF ZMLog.py:292 [Setting up signal handler for logs]

07/03/22 17:37:24 zmesdetect[405] INF ZMLog.py:301 [Switching global logger to ZMLog]

07/03/22 17:37:24 zmesdetect[405] INF zm_detect.py:284 [---------| app:6.1.28, pyzm:0.3.56, ES:6.1.28 , OpenCV:4.6.0-dev|------------]

07/03/22 17:37:24 zmesdetect[405] INF utils.py:405 [Reading config from: /etc/zm/objectconfig.ini]

07/03/22 17:37:24 zmesdetect[405] INF utils.py:410 [Reading secrets from: /etc/zm/secrets.ini]

07/03/22 17:37:24 zmesdetect[405] DBG2 utils.py:382 [Secret token found in config: !ZM_PORTAL]

07/03/22 17:37:24 zmesdetect[405] DBG2 utils.py:382 [Secret token found in config: !ZM_USER]

07/03/22 17:37:24 zmesdetect[405] DBG2 utils.py:382 [Secret token found in config: !ZM_PASSWORD]

07/03/22 17:37:24 zmesdetect[405] DBG2 utils.py:382 [Secret token found in config: !ZM_API_PORTAL]

07/03/22 17:37:24 zmesdetect[405] DBG2 utils.py:382 [Secret token found in config: !ML_USER]

07/03/22 17:37:24 zmesdetect[405] DBG2 utils.py:382 [Secret token found in config: !ML_PASSWORD]

07/03/22 17:37:24 zmesdetect[405] DBG2 utils.py:382 [Secret token found in config: !PLATEREC_ALPR_KEY]

07/03/22 17:37:24 zmesdetect[405] DBG1 utils.py:445 [allowing self-signed certs to work...]

07/03/22 17:37:24 zmesdetect[405] DBG2 utils.py:455 [Now checking for monitor overrides]

07/03/22 17:37:24 zmesdetect[405] INF utils.py:510 [Ignoring monitor specific settings, as you did not provide a monitor id]

07/03/22 17:37:24 zmesdetect[405] DBG3 utils.py:522 [Finally, doing parameter substitution]

07/03/22 17:37:24 zmesdetect[405] INF zm_detect.py:309 [Importing local classes for Object/Face]

07/03/22 17:37:24 zmesdetect[405] INF zm_detect.py:334 [Connecting with ZM APIs]

07/03/22 17:37:24 zmesdetect[405] DBG2 api.py:72 [API SSL certificate check has been disbled]

07/03/22 17:37:24 zmesdetect[405] DBG1 api.py:181 [using username/password for login]

07/03/22 17:37:24 zmesdetect[405] DBG2 api.py:210 [Using new token API]

07/03/22 17:37:24 zmesdetect[405] DBG2 zm_detect.py:342 [using ml_sequence]

07/03/22 17:37:24 zmesdetect[405] DBG2 zm_detect.py:354 [using stream_sequence]

07/03/22 17:37:24 zmesdetect[405] DBG1 detect_sequence.py:160 [Resetting models, will be loaded on next run]

07/03/22 17:37:24 zmesdetect[405] DBG3 detect_sequence.py:634 [Using automatic locking as we are switching between models]

07/03/22 17:37:24 zmesdetect[405] DBG2 Media.py:51 [Media get SSL certificate check has been disbled]

07/03/22 17:37:24 zmesdetect[405] DBG2 Media.py:99 [Using URL 25 for stream]

07/03/22 17:37:24 zmesdetect[405] DBG2 Media.py:114 [We will only process frames: ['snapshot', 'alarm']]

07/03/22 17:37:24 zmesdetect[405] DBG2 Media.py:137 [No need to start streams, we are picking images from http://192.168.99.97/zm/index.php?view=image&eid=25]

07/03/22 17:37:24 zmesdetect[405] DBG3 Media.py:271 [Reading http://192.168.99.97/zm/index.php?view=image&eid=25&fid=snapshot]

07/03/22 17:37:24 zmesdetect[405] DBG3 api.py:272 [make_request called with url=http://192.168.99.97/zm/index.php?view=image&eid=25&fid=snapshot payload={} type=get query={'token': None}]

07/03/22 17:37:24 zmesdetect[405] DBG1 detect_sequence.py:654 [perf: Starting for frame:snapshot]

07/03/22 17:37:24 zmesdetect[405] DBG1 detect_sequence.py:664 [Sequence of detection types to execute: ['object', 'face', 'alpr']]

07/03/22 17:37:24 zmesdetect[405] DBG1 detect_sequence.py:669 [============ Frame: snapshot Running object detection type in sequence ==================]

07/03/22 17:37:24 zmesdetect[405] DBG2 detect_sequence.py:174 [Skipping TPU object detection as it is disabled]

07/03/22 17:37:24 zmesdetect[405] DBG2 detect_sequence.py:178 [Loading sequence: YoloV4 GPU/CPU]

07/03/22 17:37:24 zmesdetect[405] DBG2 detect_sequence.py:179 [Initializing model type:object with options:{'name': 'YoloV4 GPU/CPU', 'enabled': 'yes', 'object_config': '/var/lib/zmeventnotification/models/yolov4/yolov4.cfg', 'object_weights': '/var/lib/zmeventnotification/models/yolov4/yolov4.weights', 'object_labels': '/var/lib/zmeventnotification/models/yolov4/coco.names', 'object_min_confidence': 0.3, 'object_framework': 'opencv', 'object_processor': 'gpu', 'gpu_max_processes': 3, 'gpu_max_lock_wait': 120, 'cpu_max_processes': 3, 'cpu_max_lock_wait': 300, 'max_detection_size': '90%', 'disable_locks': 'no'}]

07/03/22 17:37:24 zmesdetect[405] DBG2 yolo.py:45 [portalock: max:3, name:pyzm_uid33_gpu_lock, timeout:120]

07/03/22 17:37:24 zmesdetect[405] DBG3 detect_sequence.py:689 [object has a same_model_sequence strategy of first]

07/03/22 17:37:24 zmesdetect[405] DBG1 detect_sequence.py:701 [--------- Frame:snapshot Running variation: #1 -------------]

07/03/22 17:37:24 zmesdetect[405] DBG2 yolo.py:143 [detect extracted image dimensions as: 800wx450h]

07/03/22 17:37:24 zmesdetect[405] DBG2 yolo.py:59 [Waiting for pyzm_uid33_gpu_lock portalock...]

07/03/22 17:37:24 zmesdetect[405] DBG2 yolo.py:61 [Got pyzm_uid33_gpu_lock portalock]

07/03/22 17:37:24 zmesdetect[405] DBG1 yolo.py:93 [|--------- Loading "YoloV4 GPU/CPU" model from disk -------------|]

07/03/22 17:37:24 zmesdetect[405] DBG2 yolo.py:77 [Released pyzm_uid33_gpu_lock portalock]

07/03/22 17:37:24 zmesdetect[405] ERR detect_sequence.py:713 [Error running model: can only concatenate str (not "int") to str]

07/03/22 17:37:24 zmesdetect[405] DBG2 detect_sequence.py:714 [Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/detect_sequence.py", line 710, in detect_stream _b,_l,_c,_m = m.detect(image=frame) File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/object.py", line 65, in detect b,l,c,_model_names = self.model.detect(image) File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 164, in detect self.load_model() File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 100, in load_model cv2_ver = cv2_version() File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 20, in cv2_version return int(maj + minor + patch) TypeError: can only concatenate str (not "int") to str ]

07/03/22 17:37:24 zmesdetect[405] DBG2 detect_sequence.py:770 [We did not find any object matches in frame: snapshot]

07/03/22 17:37:24 zmesdetect[405] DBG1 detect_sequence.py:669 [============ Frame: snapshot Running face detection type in sequence ==================]

07/03/22 17:37:24 zmesdetect[405] DBG2 detect_sequence.py:190 [Skipping TPU face detection as it is disabled]

07/03/2022 17:37:26 zmesdetect[405] DBG1 face_dlib.py:42 [perf: processor:gpu Face Recognition library load time took: 0.00 ms ]

07/03/2022 17:37:26 zmesdetect[405] DBG1 face_dlib.py:50 [Initializing face recognition with model:cnn upsample:1, jitters:0]

07/03/2022 17:37:26 zmesdetect[405] DBG2 face_dlib.py:73 [portalock: max:3, name:pyzm_uid33_gpu_lock, timeout:120]

07/03/2022 17:37:26 zmesdetect[405] DBG1 face_dlib.py:97 [trained file not found, reading from images and doing training...]

07/03/2022 17:37:26 zmesdetect[405] DBG1 face_dlib.py:100 [If you are using a GPU and run out of memory, do the training using zm_train_faces.py. In this case, other models like yolo may already take up a lot of GPU memory]

07/03/2022 17:37:26 zmesdetect[405] ERR face_train_dlib.py:135 [No known faces found to train, encoding file not created]

07/03/2022 17:37:26 zmesdetect[405] DBG1 face_train_dlib.py:152 [perf: Face Recognition training took: 4.33 ms]

07/03/2022 17:37:26 zmesdetect[405] ERR face_dlib.py:110 [Error loading KNN model: [Errno 2] No such file or directory: '/var/lib/zmeventnotification/known_faces/faces.dat']

07/03/2022 17:37:26 zmesdetect[405] DBG3 detect_sequence.py:689 [face has a same_model_sequence strategy of union]

07/03/2022 17:37:26 zmesdetect[405] DBG1 detect_sequence.py:701 [--------- Frame:snapshot Running variation: #1 -------------]

07/03/2022 17:37:26 zmesdetect[405] DBG1 face_dlib.py:164 [|---------- Dlib Face recognition (input image: 800w*450h) ----------|]

07/03/2022 17:37:26 zmesdetect[405] DBG3 face_dlib.py:174 [Face options={'name': 'DLIB based face recognition', 'enabled': 'yes', 'save_unknown_faces': 'yes', 'save_unknown_faces_leeway_pixels': 100, 'face_detection_framework': 'dlib', 'known_images_path': '/var/lib/zmeventnotification/known_faces', 'unknown_images_path': '/var/lib/zmeventnotification/unknown_faces', 'face_model': 'cnn', 'face_train_model': 'cnn', 'face_recog_dist_threshold': '0.6', 'face_num_jitters': '5', 'face_upsample_times': '2', 'gpu_max_processes': 3, 'gpu_max_lock_wait': 120, 'cpu_max_processes': 3, 'cpu_max_lock_wait': 300, 'max_size': 800, 'disable_locks': 'no'}]

07/03/2022 17:37:26 zmesdetect[405] DBG2 face_dlib.py:123 [Waiting for pyzm_uid33_gpu_lock portalock...]

07/03/2022 17:37:26 zmesdetect[405] DBG2 face_dlib.py:125 [Got pyzm_uid33_gpu_lock lock...]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:206 [perf: processor:gpu Finding faces took 2422.13 ms]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:141 [Released pyzm_uid33_gpu_lock portalock]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:218 [perf: processor:gpu Computing face recognition distances took 65.30 ms]

07/03/2022 17:37:29 zmesdetect[405] DBG3 face_dlib.py:227 [Comparing to known faces...]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:246 [No faces to match, so creating empty set]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:249 [perf: processor:gpu Matching recognized faces to known faces took 0.29 ms]

07/03/2022 17:37:29 zmesdetect[405] INF face_dlib.py:286 [Saving cropped unknown face at [312,38,611,336 - includes leeway of 100px] to /var/lib/zmeventnotification/unknown_faces/Jul03-17h37m29s-bf2a1643-2228-44b6-a265-07231212e696.jpg]

07/03/2022 17:37:29 zmesdetect[405] DBG2 face_dlib.py:298 [Face Dlib:Returning: [[412, 138, 511, 236]], ['unknown'], [1]]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:711 [This model iteration inside face found: labels: ['unknown'],conf:[1]]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:424 [Max object size found to be: 90%]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:432 [Converted 90% to 324000.0]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:448 [No polygons, adding full image polygon: {'name': 'full_image', 'value': [(0, 0), (1920, 0), (1920, 1080), (0, 1080)], 'pattern': None}]

07/03/2022 17:37:29 zmesdetect[405] DBG3 detect_sequence.py:228 [resized polygons x=0.4166666666666667/y=0.4166666666666667: [{'name': 'full_image', 'value': [(0, 0), (800, 0), (800, 450), (0, 450)], 'pattern': None}]]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:502 [intersection: object:unknown,POLYGON ((412 138, 511 138, 511 236, 412 236, 412 138)) intersects polygon:full_image,POLYGON ((0 0, 800 0, 800 450, 0 450, 0 0))]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:518 [Using global match pattern: .*]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:526 [full_image intersects object:unknown[[(412, 138), (511, 138), (511, 236), (412, 236)]]]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:669 [============ Frame: snapshot Running alpr detection type in sequence ==================]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:672 [Making sure we have matched one of ['car', 'motorbike', 'bus', 'truck', 'boat'] in ['unknown'] before we proceed]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:674 [Did not find pre existing labels, not running detection type]

07/03/2022 17:37:29 zmesdetect[405] DBG3 Media.py:271 [Reading http://192.168.99.97/zm/index.php?view=image&eid=25&fid=alarm]

07/03/2022 17:37:29 zmesdetect[405] DBG3 api.py:272 [make_request called with url=http://192.168.99.97/zm/index.php?view=image&eid=25&fid=alarm payload={} type=get query={'token': None}]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:654 [perf: Starting for frame:alarm]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:664 [Sequence of detection types to execute: ['object', 'face', 'alpr']]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:669 [============ Frame: alarm Running object detection type in sequence ==================]

07/03/2022 17:37:29 zmesdetect[405] DBG3 detect_sequence.py:689 [object has a same_model_sequence strategy of first]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:701 [--------- Frame:alarm Running variation: #1 -------------]

07/03/2022 17:37:29 zmesdetect[405] DBG2 yolo.py:143 [detect extracted image dimensions as: 800wx450h]

07/03/2022 17:37:29 zmesdetect[405] DBG2 yolo.py:59 [Waiting for pyzm_uid33_gpu_lock portalock...]

07/03/2022 17:37:29 zmesdetect[405] DBG2 yolo.py:61 [Got pyzm_uid33_gpu_lock portalock]

07/03/2022 17:37:29 zmesdetect[405] DBG1 yolo.py:166 [|---------- YOLO (input image: 800w450h, model resize dimensions: 416w416h) ----------|]

07/03/2022 17:37:29 zmesdetect[405] DBG2 yolo.py:77 [Released pyzm_uid33_gpu_lock portalock]

07/03/2022 17:37:29 zmesdetect[405] ERR detect_sequence.py:713 [Error running model: invalid index to scalar variable.]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:714 [Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/detect_sequence.py", line 710, in detect_stream _b,_l,_c,_m = m.detect(image=frame) File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/object.py", line 65, in detect b,l,c,_model_names = self.model.detect(image) File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 173, in detect ln = self.get_output_layers() File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 136, in get_output_layers output_layers = [ File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 137, in layer_names[i[0] - 1] for i in self.net.getUnconnectedOutLayers() IndexError: invalid index to scalar variable. ]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:770 [We did not find any object matches in frame: alarm]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:669 [============ Frame: alarm Running face detection type in sequence ==================]

07/03/2022 17:37:29 zmesdetect[405] DBG3 detect_sequence.py:689 [face has a same_model_sequence strategy of union]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:701 [--------- Frame:alarm Running variation: #1 -------------]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:164 [|---------- Dlib Face recognition (input image: 800w*450h) ----------|]

07/03/2022 17:37:29 zmesdetect[405] DBG3 face_dlib.py:174 [Face options={'name': 'DLIB based face recognition', 'enabled': 'yes', 'save_unknown_faces': 'yes', 'save_unknown_faces_leeway_pixels': 100, 'face_detection_framework': 'dlib', 'known_images_path': '/var/lib/zmeventnotification/known_faces', 'unknown_images_path': '/var/lib/zmeventnotification/unknown_faces', 'face_model': 'cnn', 'face_train_model': 'cnn', 'face_recog_dist_threshold': '0.6', 'face_num_jitters': '5', 'face_upsample_times': '2', 'gpu_max_processes': 3, 'gpu_max_lock_wait': 120, 'cpu_max_processes': 3, 'cpu_max_lock_wait': 300, 'max_size': 800, 'disable_locks': 'no'}]

07/03/2022 17:37:29 zmesdetect[405] DBG2 face_dlib.py:123 [Waiting for pyzm_uid33_gpu_lock portalock...]

07/03/2022 17:37:29 zmesdetect[405] DBG2 face_dlib.py:125 [Got pyzm_uid33_gpu_lock lock...]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:206 [perf: processor:gpu Finding faces took 105.68 ms]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:141 [Released pyzm_uid33_gpu_lock portalock]

07/03/2022 17:37:29 zmesdetect[405] DBG1 face_dlib.py:218 [perf: processor:gpu Computing face recognition distances took 0.37 ms]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:711 [This model iteration inside face found: labels: [],conf:[]]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:424 [Max object size found to be: 90%]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:432 [Converted 90% to 324000.0]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:770 [We did not find any face matches in frame: alarm]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:669 [============ Frame: alarm Running alpr detection type in sequence ==================]

07/03/2022 17:37:29 zmesdetect[405] DBG2 detect_sequence.py:672 [Making sure we have matched one of ['car', 'motorbike', 'bus', 'truck', 'boat'] in [] before we proceed]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:674 [Did not find pre existing labels, not running detection type]

07/03/2022 17:37:29 zmesdetect[405] DBG1 detect_sequence.py:827 [perf: TOTAL detection sequence (with image loads) took: 4872.47 ms to process 25]

07/03/2022 17:37:29 zmesdetect[405] INF zm_detect.py:479 [Prediction string:[s] detected:unknown:100% ]

07/03/2022 17:37:29 zmesdetect[405] DBG1 zm_detect.py:481 [Prediction string JSON:{"labels": ["unknown"], "boxes": [[412, 138, 511, 236]], "frame_id": "snapshot", "confidences": [1], "image_dimensions": {"original": [1080, 1920], "resized": [450, 800]}}]

[s] detected:unknown:100% --SPLIT--{"labels": ["unknown"], "boxes": [[412, 138, 511, 236]], "frame_id": "snapshot", "confidences": [1], "image_dimensions": {"original": [1080, 1920], "resized": [450, 800]}} 07/03/2022 17:37:29 zmesdetect[405] DBG1 zm_detect.py:557 [Closing logs]`

baudneo commented 2 years ago

One moment, you'll need to re wget the file and copy it again. I just need to push a quick change. I think it's the "patch" var being set as 0. Should be "0" instead

baudneo commented 2 years ago

Rerun the wget and copy CMD and let me.k ow if it works now.

I run my own custom versions of ZMES so I can't test this code myself.

Edit: I see it's 4.6.0-dev, can you run this command for me please python3 -c 'import cv2; x = cv2.__version__; print(x); print(x.split(".")); quit()'

baudneo commented 2 years ago

try rerunning wget and copying now. Im assuming OpenCV devs are going to change their version formatting on the next minor release just to piss more people off and break code again.

juan11perez commented 2 years ago

@baudneo

root@zone:/# python3 -c 'import cv2; x = cv2.__version__; print(x); print(x.split(".")); quit()' 4.6.0-dev ['4', '6', '0-dev']

Downloaded your recent fix. still throwing errors.

`07/03/22 21:49:40 zmesdetect[692] INF ZMLog.py:301 [Switching global logger to ZMLog]

07/03/22 21:49:40 zmesdetect[692] INF zm_detect.py:284 [---------| app:6.1.28, pyzm:0.3.56, ES:6.1.28 , OpenCV:4.6.0-dev|------------]

07/03/22 21:49:40 zmesdetect[692] INF utils.py:405 [Reading config from: /etc/zm/objectconfig.ini]

07/03/22 21:49:40 zmesdetect[692] INF utils.py:410 [Reading secrets from: /etc/zm/secrets.ini]

07/03/22 21:49:40 zmesdetect[692] DBG2 utils.py:382 [Secret token found in config: !ZM_PORTAL]

07/03/22 21:49:40 zmesdetect[692] DBG2 utils.py:382 [Secret token found in config: !ZM_USER]

07/03/22 21:49:40 zmesdetect[692] DBG2 utils.py:382 [Secret token found in config: !ZM_PASSWORD]

07/03/22 21:49:40 zmesdetect[692] DBG2 utils.py:382 [Secret token found in config: !ZM_API_PORTAL]

07/03/22 21:49:40 zmesdetect[692] DBG2 utils.py:382 [Secret token found in config: !ML_USER]

07/03/22 21:49:40 zmesdetect[692] DBG2 utils.py:382 [Secret token found in config: !ML_PASSWORD]

07/03/22 21:49:40 zmesdetect[692] DBG2 utils.py:382 [Secret token found in config: !PLATEREC_ALPR_KEY]

07/03/22 21:49:40 zmesdetect[692] DBG1 utils.py:445 [allowing self-signed certs to work...]

07/03/22 21:49:40 zmesdetect[692] DBG2 utils.py:455 [Now checking for monitor overrides]

07/03/22 21:49:40 zmesdetect[692] INF utils.py:510 [Ignoring monitor specific settings, as you did not provide a monitor id]

07/03/22 21:49:40 zmesdetect[692] DBG3 utils.py:522 [Finally, doing parameter substitution]

07/03/22 21:49:40 zmesdetect[692] INF zm_detect.py:309 [Importing local classes for Object/Face]

07/03/22 21:49:40 zmesdetect[692] INF zm_detect.py:334 [Connecting with ZM APIs]

07/03/22 21:49:40 zmesdetect[692] DBG2 api.py:72 [API SSL certificate check has been disbled]

07/03/22 21:49:40 zmesdetect[692] DBG1 api.py:181 [using username/password for login]

07/03/22 21:49:40 zmesdetect[692] DBG2 api.py:210 [Using new token API]

07/03/22 21:49:40 zmesdetect[692] DBG2 zm_detect.py:342 [using ml_sequence]

07/03/22 21:49:40 zmesdetect[692] DBG2 zm_detect.py:354 [using stream_sequence]

07/03/22 21:49:40 zmesdetect[692] DBG1 detect_sequence.py:160 [Resetting models, will be loaded on next run]

07/03/22 21:49:40 zmesdetect[692] DBG3 detect_sequence.py:634 [Using automatic locking as we are switching between models]

07/03/22 21:49:40 zmesdetect[692] DBG2 Media.py:51 [Media get SSL certificate check has been disbled]

07/03/22 21:49:40 zmesdetect[692] DBG2 Media.py:99 [Using URL 25 for stream]

07/03/22 21:49:40 zmesdetect[692] DBG2 Media.py:114 [We will only process frames: ['snapshot', 'alarm']]

07/03/22 21:49:40 zmesdetect[692] DBG2 Media.py:137 [No need to start streams, we are picking images from http://192.168.99.97/zm/index.php?view=image&eid=25]

07/03/22 21:49:40 zmesdetect[692] DBG3 Media.py:271 [Reading http://192.168.99.97/zm/index.php?view=image&eid=25&fid=snapshot]

07/03/22 21:49:40 zmesdetect[692] DBG3 api.py:272 [make_request called with url=http://192.168.99.97/zm/index.php?view=image&eid=25&fid=snapshot payload={} type=get query={'token': None}]

07/03/22 21:49:40 zmesdetect[692] DBG1 detect_sequence.py:654 [perf: Starting for frame:snapshot]

07/03/22 21:49:40 zmesdetect[692] DBG1 detect_sequence.py:664 [Sequence of detection types to execute: ['object', 'face', 'alpr']]

07/03/22 21:49:40 zmesdetect[692] DBG1 detect_sequence.py:669 [============ Frame: snapshot Running object detection type in sequence ==================]

07/03/22 21:49:40 zmesdetect[692] DBG2 detect_sequence.py:174 [Skipping TPU object detection as it is disabled]

07/03/22 21:49:40 zmesdetect[692] DBG2 detect_sequence.py:178 [Loading sequence: YoloV4 GPU/CPU]

07/03/22 21:49:40 zmesdetect[692] DBG2 detect_sequence.py:179 [Initializing model type:object with options:{'name': 'YoloV4 GPU/CPU', 'enabled': 'yes', 'object_config': '/var/lib/zmeventnotification/models/yolov4/yolov4.cfg', 'object_weights': '/var/lib/zmeventnotification/models/yolov4/yolov4.weights', 'object_labels': '/var/lib/zmeventnotification/models/yolov4/coco.names', 'object_min_confidence': 0.3, 'object_framework': 'opencv', 'object_processor': 'gpu', 'gpu_max_processes': 3, 'gpu_max_lock_wait': 120, 'cpu_max_processes': 3, 'cpu_max_lock_wait': 300, 'max_detection_size': '90%', 'disable_locks': 'no'}]

07/03/22 21:49:40 zmesdetect[692] DBG2 yolo.py:54 [portalock: max:3, name:pyzm_uid33_gpu_lock, timeout:120]

07/03/22 21:49:40 zmesdetect[692] DBG3 detect_sequence.py:689 [object has a same_model_sequence strategy of first]

07/03/22 21:49:40 zmesdetect[692] DBG1 detect_sequence.py:701 [--------- Frame:snapshot Running variation: #1 -------------]

07/03/22 21:49:40 zmesdetect[692] DBG2 yolo.py:152 [detect extracted image dimensions as: 800wx450h]

07/03/22 21:49:40 zmesdetect[692] DBG2 yolo.py:68 [Waiting for pyzm_uid33_gpu_lock portalock...]

07/03/22 21:49:40 zmesdetect[692] DBG2 yolo.py:70 [Got pyzm_uid33_gpu_lock portalock]

07/03/22 21:49:40 zmesdetect[692] DBG1 yolo.py:102 [|--------- Loading "YoloV4 GPU/CPU" model from disk -------------|]

07/03/22 21:49:40 zmesdetect[692] DBG2 yolo.py:86 [Released pyzm_uid33_gpu_lock portalock]

07/03/22 21:49:40 zmesdetect[692] ERR detect_sequence.py:713 [Error running model: name 'ver' is not defined]

07/03/22 21:49:40 zmesdetect[692] DBG2 detect_sequence.py:714 [Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/detect_sequence.py", line 710, in detect_stream _b,_l,_c,_m = m.detect(image=frame) File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/object.py", line 65, in detect b,l,c,_model_names = self.model.detect(image) File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 173, in detect self.load_model() File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 109, in load_model cv2_ver = cv2_version() File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 19, in cv2_version x = ver.split(".") NameError: name 'ver' is not defined ]

07/03/22 21:49:40 zmesdetect[692] DBG2 detect_sequence.py:770 [We did not find any object matches in frame: snapshot]

07/03/22 21:49:40 zmesdetect[692] DBG1 detect_sequence.py:669 [============ Frame: snapshot Running face detection type in sequence ==================]

07/03/22 21:49:40 zmesdetect[692] DBG2 detect_sequence.py:190 [Skipping TPU face detection as it is disabled]

07/03/2022 21:49:42 zmesdetect[692] DBG1 face_dlib.py:42 [perf: processor:gpu Face Recognition library load time took: 0.00 ms ]

07/03/2022 21:49:42 zmesdetect[692] DBG1 face_dlib.py:50 [Initializing face recognition with model:cnn upsample:1, jitters:0]

07/03/2022 21:49:42 zmesdetect[692] DBG2 face_dlib.py:73 [portalock: max:3, name:pyzm_uid33_gpu_lock, timeout:120]

07/03/2022 21:49:42 zmesdetect[692] DBG1 face_dlib.py:97 [trained file not found, reading from images and doing training...]

07/03/2022 21:49:42 zmesdetect[692] DBG1 face_dlib.py:100 [If you are using a GPU and run out of memory, do the training using zm_train_faces.py. In this case, other models like yolo may already take up a lot of GPU memory]

07/03/2022 21:49:42 zmesdetect[692] ERR face_train_dlib.py:135 [No known faces found to train, encoding file not created]

07/03/2022 21:49:42 zmesdetect[692] DBG1 face_train_dlib.py:152 [perf: Face Recognition training took: 3.88 ms]

07/03/2022 21:49:42 zmesdetect[692] ERR face_dlib.py:110 [Error loading KNN model: [Errno 2] No such file or directory: '/var/lib/zmeventnotification/known_faces/faces.dat']

07/03/2022 21:49:42 zmesdetect[692] DBG3 detect_sequence.py:689 [face has a same_model_sequence strategy of union]

07/03/2022 21:49:42 zmesdetect[692] DBG1 detect_sequence.py:701 [--------- Frame:snapshot Running variation: #1 -------------]

07/03/2022 21:49:42 zmesdetect[692] DBG1 face_dlib.py:164 [|---------- Dlib Face recognition (input image: 800w*450h) ----------|]

07/03/2022 21:49:42 zmesdetect[692] DBG3 face_dlib.py:174 [Face options={'name': 'DLIB based face recognition', 'enabled': 'yes', 'save_unknown_faces': 'yes', 'save_unknown_faces_leeway_pixels': 100, 'face_detection_framework': 'dlib', 'known_images_path': '/var/lib/zmeventnotification/known_faces', 'unknown_images_path': '/var/lib/zmeventnotification/unknown_faces', 'face_model': 'cnn', 'face_train_model': 'cnn', 'face_recog_dist_threshold': '0.6', 'face_num_jitters': '5', 'face_upsample_times': '2', 'gpu_max_processes': 3, 'gpu_max_lock_wait': 120, 'cpu_max_processes': 3, 'cpu_max_lock_wait': 300, 'max_size': 800, 'disable_locks': 'no'}]

07/03/2022 21:49:42 zmesdetect[692] DBG2 face_dlib.py:123 [Waiting for pyzm_uid33_gpu_lock portalock...]

07/03/2022 21:49:42 zmesdetect[692] DBG2 face_dlib.py:125 [Got pyzm_uid33_gpu_lock lock...]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:206 [perf: processor:gpu Finding faces took 3817.05 ms]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:141 [Released pyzm_uid33_gpu_lock portalock]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:218 [perf: processor:gpu Computing face recognition distances took 66.30 ms]

07/03/2022 21:49:46 zmesdetect[692] DBG3 face_dlib.py:227 [Comparing to known faces...]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:246 [No faces to match, so creating empty set]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:249 [perf: processor:gpu Matching recognized faces to known faces took 0.29 ms]

07/03/2022 21:49:46 zmesdetect[692] INF face_dlib.py:286 [Saving cropped unknown face at [312,38,611,336 - includes leeway of 100px] to /var/lib/zmeventnotification/unknown_faces/Jul03-21h49m46s-3882acb6-f613-425a-b19c-2cd6b4f267ce.jpg]

07/03/2022 21:49:46 zmesdetect[692] DBG2 face_dlib.py:298 [Face Dlib:Returning: [[412, 138, 511, 236]], ['unknown'], [1]]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:711 [This model iteration inside face found: labels: ['unknown'],conf:[1]]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:424 [Max object size found to be: 90%]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:432 [Converted 90% to 324000.0]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:448 [No polygons, adding full image polygon: {'name': 'full_image', 'value': [(0, 0), (1920, 0), (1920, 1080), (0, 1080)], 'pattern': None}]

07/03/2022 21:49:46 zmesdetect[692] DBG3 detect_sequence.py:228 [resized polygons x=0.4166666666666667/y=0.4166666666666667: [{'name': 'full_image', 'value': [(0, 0), (800, 0), (800, 450), (0, 450)], 'pattern': None}]]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:502 [intersection: object:unknown,POLYGON ((412 138, 511 138, 511 236, 412 236, 412 138)) intersects polygon:full_image,POLYGON ((0 0, 800 0, 800 450, 0 450, 0 0))]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:518 [Using global match pattern: .*]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:526 [full_image intersects object:unknown[[(412, 138), (511, 138), (511, 236), (412, 236)]]]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:669 [============ Frame: snapshot Running alpr detection type in sequence ==================]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:672 [Making sure we have matched one of ['car', 'motorbike', 'bus', 'truck', 'boat'] in ['unknown'] before we proceed]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:674 [Did not find pre existing labels, not running detection type]

07/03/2022 21:49:46 zmesdetect[692] DBG3 Media.py:271 [Reading http://192.168.99.97/zm/index.php?view=image&eid=25&fid=alarm]

07/03/2022 21:49:46 zmesdetect[692] DBG3 api.py:272 [make_request called with url=http://192.168.99.97/zm/index.php?view=image&eid=25&fid=alarm payload={} type=get query={'token': None}]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:654 [perf: Starting for frame:alarm]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:664 [Sequence of detection types to execute: ['object', 'face', 'alpr']]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:669 [============ Frame: alarm Running object detection type in sequence ==================]

07/03/2022 21:49:46 zmesdetect[692] DBG3 detect_sequence.py:689 [object has a same_model_sequence strategy of first]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:701 [--------- Frame:alarm Running variation: #1 -------------]

07/03/2022 21:49:46 zmesdetect[692] DBG2 yolo.py:152 [detect extracted image dimensions as: 800wx450h]

07/03/2022 21:49:46 zmesdetect[692] DBG2 yolo.py:68 [Waiting for pyzm_uid33_gpu_lock portalock...]

07/03/2022 21:49:46 zmesdetect[692] DBG2 yolo.py:70 [Got pyzm_uid33_gpu_lock portalock]

07/03/2022 21:49:46 zmesdetect[692] DBG1 yolo.py:175 [|---------- YOLO (input image: 800w450h, model resize dimensions: 416w416h) ----------|]

07/03/2022 21:49:46 zmesdetect[692] DBG2 yolo.py:86 [Released pyzm_uid33_gpu_lock portalock]

07/03/2022 21:49:46 zmesdetect[692] ERR detect_sequence.py:713 [Error running model: invalid index to scalar variable.]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:714 [Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/detect_sequence.py", line 710, in detect_stream _b,_l,_c,_m = m.detect(image=frame) File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/object.py", line 65, in detect b,l,c,_model_names = self.model.detect(image) File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 182, in detect ln = self.get_output_layers() File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 145, in get_output_layers output_layers = [ File "/usr/local/lib/python3.10/dist-packages/pyzm/ml/yolo.py", line 146, in layer_names[i[0] - 1] for i in self.net.getUnconnectedOutLayers() IndexError: invalid index to scalar variable. ]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:770 [We did not find any object matches in frame: alarm]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:669 [============ Frame: alarm Running face detection type in sequence ==================]

07/03/2022 21:49:46 zmesdetect[692] DBG3 detect_sequence.py:689 [face has a same_model_sequence strategy of union]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:701 [--------- Frame:alarm Running variation: #1 -------------]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:164 [|---------- Dlib Face recognition (input image: 800w*450h) ----------|]

07/03/2022 21:49:46 zmesdetect[692] DBG3 face_dlib.py:174 [Face options={'name': 'DLIB based face recognition', 'enabled': 'yes', 'save_unknown_faces': 'yes', 'save_unknown_faces_leeway_pixels': 100, 'face_detection_framework': 'dlib', 'known_images_path': '/var/lib/zmeventnotification/known_faces', 'unknown_images_path': '/var/lib/zmeventnotification/unknown_faces', 'face_model': 'cnn', 'face_train_model': 'cnn', 'face_recog_dist_threshold': '0.6', 'face_num_jitters': '5', 'face_upsample_times': '2', 'gpu_max_processes': 3, 'gpu_max_lock_wait': 120, 'cpu_max_processes': 3, 'cpu_max_lock_wait': 300, 'max_size': 800, 'disable_locks': 'no'}]

07/03/2022 21:49:46 zmesdetect[692] DBG2 face_dlib.py:123 [Waiting for pyzm_uid33_gpu_lock portalock...]

07/03/2022 21:49:46 zmesdetect[692] DBG2 face_dlib.py:125 [Got pyzm_uid33_gpu_lock lock...]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:206 [perf: processor:gpu Finding faces took 108.23 ms]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:141 [Released pyzm_uid33_gpu_lock portalock]

07/03/2022 21:49:46 zmesdetect[692] DBG1 face_dlib.py:218 [perf: processor:gpu Computing face recognition distances took 0.41 ms]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:711 [This model iteration inside face found: labels: [],conf:[]]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:424 [Max object size found to be: 90%]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:432 [Converted 90% to 324000.0]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:770 [We did not find any face matches in frame: alarm]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:669 [============ Frame: alarm Running alpr detection type in sequence ==================]

07/03/2022 21:49:46 zmesdetect[692] DBG2 detect_sequence.py:672 [Making sure we have matched one of ['car', 'motorbike', 'bus', 'truck', 'boat'] in [] before we proceed]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:674 [Did not find pre existing labels, not running detection type]

07/03/2022 21:49:46 zmesdetect[692] DBG1 detect_sequence.py:827 [perf: TOTAL detection sequence (with image loads) took: 6293.32 ms to process 25]

07/03/2022 21:49:46 zmesdetect[692] INF zm_detect.py:479 [Prediction string:[s] detected:unknown:100% ]

07/03/2022 21:49:46 zmesdetect[692] DBG1 zm_detect.py:481 [Prediction string JSON:{"labels": ["unknown"], "boxes": [[412, 138, 511, 236]], "frame_id": "snapshot", "confidences": [1], "image_dimensions": {"original": [1080, 1920], "resized": [450, 800]}}]

[s] detected:unknown:100% --SPLIT--{"labels": ["unknown"], "boxes": [[412, 138, 511, 236]], "frame_id": "snapshot", "confidences": [1], "image_dimensions": {"original": [1080, 1920], "resized": [450, 800]}} 07/03/2022 21:49:46 zmesdetect[692] DBG1 zm_detect.py:557 [Closing logs]`

baudneo commented 2 years ago

Fu*k sakes. Give me a minute. Sick and tired of opencv changing shit every minor version bump

baudneo commented 2 years ago

Wget and copy

juan11perez commented 2 years ago

@baudneo Yes, that fixed it. Thank you.

sagitt commented 2 years ago

works fine! thank you so much. I hope in an official fix.