search

blakeblackshear / frigate

NVR with realtime local object detection for IP cameras
https://frigate.video
MIT License
17.99k stars 1.64k forks source link

[Support]: Birdseye view is glitchy in MSE and RTSP/TCP modes, does not work with WebRTC, works fine in jsmpeg mode #7358

Closed erkexzcx closed 1 year ago

erkexzcx commented 1 year ago

Describe the problem you are having

Here is the thing with Birdseye camera:

Here is my relevant config:

birdseye:
  enabled: True
  restream: True
  width: 1920
  height: 1080
  mode: motion

I don't have any GPU, so there is no hardware acceleration.

Here is what I mean "glitchy":

[Click me] Red/yellowish artifacts, videos overlapping. This is visible on MSE and RTSP streams. Tried different browser and different RTSP viewers on Android - always the same glitchy view. However, it looks totally fine on jsmpeg view. :shrug: ![image](https://github.com/blakeblackshear/frigate/assets/5955795/6d9ca842-e0f1-4627-8238-e9cbcec3a375) ![image](https://github.com/blakeblackshear/frigate/assets/5955795/9143b54c-1956-4397-81e7-fcde7a1f36b2) ![image](https://github.com/blakeblackshear/frigate/assets/5955795/fbdea94c-276b-4a25-b617-955a1a104b01) Here is jsmpeg view - always work without issues: ![image](https://github.com/blakeblackshear/frigate/assets/5955795/a515d094-2177-47c6-b8b6-df6564c4bb23)

Resources is not a problem:

[Click me] ![image](https://github.com/blakeblackshear/frigate/assets/5955795/45dc1b6a-5a34-4221-919b-727a78e4d502) ![image](https://github.com/blakeblackshear/frigate/assets/5955795/045eca4e-b6a4-47ad-987e-3d899c21e885) ![image](https://github.com/blakeblackshear/frigate/assets/5955795/06bd83f9-fc38-4a6c-a0a4-55d26586766c)

Why would it happen? Any ideas?

Version

0.12.1-367d724

Frigate config file

go2rtc:
  rtsp:
    username: "myusername"
    password: "mypassword"

  webrtc:
    candidates:
      - 192.168.123.123:8555
      - 123.123.123.123:8555
      - example.com:8555

  streams:

    cam01:     ["rtsp://myusername:mypassword@192.168.0.11/Streaming/Channels/1"]
    cam01_sub: ["rtsp://myusername:mypassword@192.168.0.11/Streaming/Channels/2"]

    cam02:     ["rtsp://myusername:mypassword@192.168.0.12/Streaming/Channels/1"]
    cam02_sub: ["rtsp://myusername:mypassword@192.168.0.12/Streaming/Channels/2"]

    cam03:     ["rtsp://myusername:mypassword@192.168.0.13/Streaming/Channels/1"]
    cam03_sub: ["rtsp://myusername:mypassword@192.168.0.13/Streaming/Channels/2"]

    cam04:     ["rtsp://myusername:mypassword@192.168.0.14/Streaming/Channels/1"]
    cam04_sub: ["rtsp://myusername:mypassword@192.168.0.14/Streaming/Channels/2"]

    cam05:     ["rtsp://myusername:mypassword@192.168.0.15/Streaming/Channels/1"]
    cam05_sub: ["rtsp://myusername:mypassword@192.168.0.15/Streaming/Channels/2"]

    cam06:     ["rtsp://myusername:mypassword@192.168.0.16/Streaming/Channels/1"]
    cam06_sub: ["rtsp://myusername:mypassword@192.168.0.16/Streaming/Channels/2"]

    cam07:     ["rtsp://myusername:mypassword@192.168.0.17/Streaming/Channels/1"]
    cam07_sub: ["rtsp://myusername:mypassword@192.168.0.17/Streaming/Channels/2"]

    cam08:     ["rtsp://myusername:mypassword@192.168.0.18/Streaming/Channels/1"]
    cam08_sub: ["rtsp://myusername:mypassword@192.168.0.18/Streaming/Channels/2"]

    cam09:     ["rtsp://myusername:mypassword@192.168.0.19/Streaming/Channels/1"]
    cam09_sub: ["rtsp://myusername:mypassword@192.168.0.19/Streaming/Channels/2"]

    cam10:     ["rtsp://myusername:mypassword@192.168.0.20/cam/realmonitor?channel=1&subtype=0"]
    cam10_sub: ["rtsp://myusername:mypassword@192.168.0.20/cam/realmonitor?channel=1&subtype=1"]

    cam11:     ["rtsp://myusername:mypassword@192.168.0.21/cam/realmonitor?channel=1&subtype=0"]
    cam11_sub: ["rtsp://myusername:mypassword@192.168.0.21/cam/realmonitor?channel=1&subtype=1"]

    cam12:     ["rtsp://myusername:mypassword@192.168.0.22/Streaming/Channels/1"]
    cam12_sub: ["rtsp://myusername:mypassword@192.168.0.22/Streaming/Channels/2"]

    cam13:     ["rtsp://myusername:mypassword@192.168.0.23/Streaming/Channels/1"]
    cam13_sub: ["rtsp://myusername:mypassword@192.168.0.23/Streaming/Channels/2"]

    cam14:     ["rtsp://myusername:mypassword@192.168.0.24/Streaming/Channels/1"]
    cam14_sub: ["rtsp://myusername:mypassword@192.168.0.24/Streaming/Channels/2"]

    cam15:     ["rtsp://myusername:mypassword@192.168.0.25/Streaming/Channels/1"]
    cam15_sub: ["rtsp://myusername:mypassword@192.168.0.25/Streaming/Channels/2"]

    cam16:     ["rtsp://myusername:mypassword@192.168.0.26/Streaming/Channels/1"]
    cam16_sub: ["rtsp://myusername:mypassword@192.168.0.26/Streaming/Channels/2"]

    cam17:     ["rtsp://myusername:mypassword@192.168.0.27/Streaming/Channels/1"]
    cam17_sub: ["rtsp://myusername:mypassword@192.168.0.27/Streaming/Channels/2"]

    cam18:     ["rtsp://myusername:mypassword@192.168.0.28/Streaming/Channels/1"]
    cam18_sub: ["rtsp://myusername:mypassword@192.168.0.28/Streaming/Channels/2"]

    cam19:     ["rtsp://myusername:mypassword@192.168.0.29/cam/realmonitor?channel=1&subtype=0"]
    cam19_sub: ["rtsp://myusername:mypassword@192.168.0.29/cam/realmonitor?channel=1&subtype=1"]

    cam20:     ["rtsp://myusername:mypassword@192.168.0.30/cam/realmonitor?channel=1&subtype=0"]
    cam20_sub: ["rtsp://myusername:mypassword@192.168.0.30/cam/realmonitor?channel=1&subtype=1"]

    cam21:     ["rtsp://myusername:mypassword@192.168.0.31/cam/realmonitor?channel=1&subtype=0"]
    cam21_sub: ["rtsp://myusername:mypassword@192.168.0.31/cam/realmonitor?channel=1&subtype=1"]

cameras:
  "cam01":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam01
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam01_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam01}
    motion:
      mask:
        - 1280,0,195,0,375,39,556,94,801,174,1073,295,1280,400
        - 0,720,119,720,65,406,64,164,186,288,195,236,124,84,43,0,0,0

  "cam02":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam02
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam02_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam02}
    motion:
      mask:
        - 0,279,849,0,0,0

  "cam03":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam03
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam03_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam03}
    motion:
      mask:
        - 357,0,212,91,0,142,0,0
        - 1280,0,1280,128,1064,94,1066,58,906,0

  "cam04":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam04
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam04_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam04}
    motion:
      mask:
        - 1280,0,350,0,347,45,421,46,415,102,560,80,932,76,1280,99,1280,101
        - 269,115,356,48,359,0,0,0,0,274
        - 0,625,44,627,128,419,113,311,0,309
    objects:
      filters:
        person:
          max_area: 7500
          mask:
            - 1143,220,141,192,1092,313,1101,234

  "cam05":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam05
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam05_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam05}

  "cam06":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam06
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam06_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam06}
    motion:
      mask:
        - 633,57,971,67,1102,88,1280,161,1280,0,380,0,377,64

  "cam07":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam07
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam07_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam07}
    motion:
      mask:
        - 0,0,1280,0,1280,180,1125,129,1159,49,960,55,721,112,587,133,314,172,0,265
        - 96,433,173,397,235,373,320,372,439,344,459,290,397,261,310,243,192,272,0,347,0,513
        - 559,408,499,420,471,275,548,264
      improve_contrast: False

  "cam08":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam08
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam08_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam08}
    motion:
      mask:
        - 1280,0,1280,273,763,56,675,51,524,56,519,91,446,99,289,66,292,0
    objects:
      filters:
        person:
          mask:
            - 310,178,305,104,171,110,173,231

  "cam09":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam09
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam09_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam09}

  "cam10":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam10
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam10_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam10}
    motion:
      mask:
        - 1055,720,1280,720,1280,400,959,356
        - 1280,312,1280,355,747,274,708,170,1124,233
        - 1280,0,1280,248,1062,175,837,144,480,94,0,135,0,0
        - 0,720,447,720,575,291,210,275,0,388

  "cam11":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam11
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam11_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam11}
    objects:
      track:
        - person
        - car
      filters:
        car:
          mask:
            - 965,416,1013,632,601,630,655,404
    motion:
      delta_alpha: 0.1
      mask:
        - 824,144,1044,154,1255,471,1231,556,1103,520,998,420,721,394,635,364,639,253,681,164
        - 27,287,22,364,302,377,573,150,206,144
        - 0,0,0,131,330,0
        - 1280,0,1280,83,999,0
        - 955,428,1005,627,620,616,663,421

  "cam12":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam12
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam12_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam12}

  "cam13":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam13
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam13_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam13}

  "cam14":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam14
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam14_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam14}
    motion:
      mask:
        - 1058,0,1182,27,1136,138,1048,120
    objects:
      filters:
        person:
          mask:
            - 1177,32,1137,135,1182,27,1060,0

  "cam15":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam15
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam15_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam15}
    motion:
      mask:
        - 0,0,229,0,228,155,0,227
        - 1059,0,1099,28,1197,36,1194,0

  "cam16":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam16
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam16_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam16}

  "cam17":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam17
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam17_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam17}
    motion:
      mask:
        - 0,720,260,720,0,54
        - 867,698,1055,720,1107,663,1075,512,959,439,789,509,742,599
        - 315,213,461,222,564,206,583,162,534,146,559,85,635,85,628,129,783,163,811,0,0,0,0,50,103,45,245,136,333,175,194,162,226,194
        - 1280,0,1280,301,1212,527,1131,493,1239,139,1224,38,1131,0

  "cam18":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam18
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam18_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam18}

  "cam19":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam19
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam19_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam19}
    motion:
      threshold: 30
      contour_area: 35
      mask:
        - 53,328,671,557,950,362,1027,377,860,720,1280,720,1280,0,0,0,0,338
    objects:
      filters:
        person:
          mask:
            - 134,318,671,558,854,430,766,411,362,330,366,216,0,236,0,338

  "cam20":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam20
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam20_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam20}
    motion:
      mask:
        - 602,0,612,91,290,192,277,125,206,140,214,204,0,290,0,0
        - 1280,720,707,720,672,319,1280,311

  "cam21":
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam21
          input_args: preset-rtsp-restream
          roles: [record]
        - path: rtsp://127.0.0.1:8554/cam21_sub
          input_args: preset-rtsp-restream
          roles: [detect]
    live: {stream_name: cam21}
    objects:
      track:
        - person
        - car
      filters:
        person:
          mask:
            - 166,300,0,373,0,240
    motion:
      mask:
        - 0,0,1280,0,1280,419,950,275,943,231,1025,213,983,190,327,281,0,238,0,246,160,304,0,345
      threshold: 30
      contour_area: 40

mqtt:
  host: mosquitto

database:
  path: /db/frigate.db

birdseye:
  enabled: True
  restream: True
  width: 1920
  height: 1080
  mode: motion

detectors:
  coral:
    type: edgetpu
    device: usb
    model:
      path: "/edgetpu_model.tflite"

snapshots:
  enabled: True
  crop: True
  clean_copy: False

motion:
  improve_contrast: True

record:
  enabled: True
  retain:
    days: 30
    mode: motion
  events:
    retain:
      default: 90
      mode: active_objects

objects:
  track:
    - person

Relevant log output

Nothing special?

2023-08-01 16:40:37.652465281  [INFO] Starting Frigate...
2023-08-01 16:40:39.156657996  [2023-08-01 16:40:39] frigate.app                    INFO    : Starting Frigate (0.12.1-367d724)
2023-08-01 16:40:39.323000321  [2023-08-01 16:40:39] frigate.config                 WARNING : Customizing more than a detector model path is unsupported.
2023-08-01 16:40:39.370931568  [2023-08-01 16:40:39] peewee_migrate                 INFO    : Starting migrations
2023-08-01 16:40:39.377008188  [2023-08-01 16:40:39] peewee_migrate                 INFO    : There is nothing to migrate
2023-08-01 16:40:39.427569881  [2023-08-01 16:40:39] detector.coral                 INFO    : Starting detection process: 669
2023-08-01 16:40:39.429395228  [2023-08-01 16:40:39] frigate.app                    INFO    : Output process started: 671
2023-08-01 16:40:39.439487512  [2023-08-01 16:40:39] frigate.app                    INFO    : Camera processor started for camxxx: 678
2023-08-01 16:40:39.452284711  [2023-08-01 16:40:39] frigate.app                    INFO    : Camera processor started for camxxx: 681
2023-08-01 16:40:39.453479939  [2023-08-01 16:40:39] frigate.app                    INFO    : Camera processor started for camxxx: 683
...
...
...
2023-08-01 16:40:42.531932815  [2023-08-01 16:40:39] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2023-08-01 16:40:42.540195360  [2023-08-01 16:40:42] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2023-08-02 00:13:00.956794212  [2023-08-02 00:13:00] frigate.watchdog               INFO    : Detection appears to be stuck. Restarting detection process...
2023-08-02 00:13:00.956933061  [2023-08-02 00:13:00] root                           INFO    : Waiting for detection process to exit gracefully...
2023-08-02 00:13:30.984035058  [2023-08-02 00:13:30] root                           INFO    : Detection process didnt exit. Force killing...
2023-08-02 00:13:31.004671417  [2023-08-02 00:13:31] root                           INFO    : Detection process has exited...
2023-08-02 00:13:31.032787936  [2023-08-02 00:13:31] detector.coral                 INFO    : Starting detection process: 1039787
2023-08-02 00:13:34.134217418  [2023-08-02 00:13:31] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2023-08-02 00:13:34.140609328  [2023-08-02 00:13:34] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2023-08-02 03:58:35.261318057  [2023-08-02 03:58:35] frigate.object_processing      WARNING : Unable to create jpg because frame 1690963112.198455 is not in the cache
2023-08-02 03:58:37.754456005  [2023-08-02 03:58:37] frigate.object_processing      WARNING : Unable to create jpg because frame 1690963112.198455 is not in the cache
2023-08-02 03:58:37.754647804  [2023-08-02 03:58:37] frigate.object_processing      WARNING : Unable to save snapshot for 1690963005.206073-xxnwqs.
2023-08-02 03:58:37.755838278  [2023-08-02 03:58:37] frigate.object_processing      WARNING : Unable to create jpg because frame 1690963112.198455 is not in the cache
2023-08-02 03:58:37.878394877  [2023-08-02 03:58:37] frigate.object_processing      WARNING : Unable to create jpg because frame 1690963112.198455 is not in the cache
2023-08-02 03:58:37.878716236  [2023-08-02 03:58:37] frigate.object_processing      WARNING : Unable to send mqtt snapshot for 1690963005.206073-xxnwqs.

FFprobe output from your camera

Several examples:

----

Stream 0:
Return Code: 0

Video:

Codec: H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
Resolution: 1920x1080
FPS: 49/4

Stream 1:
Return Code: 0

Video:

Codec: H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
Resolution: 704x480
FPS: 6/1

----

Stream 0:
Return Code: 0

Video:

Codec: H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
Resolution: 1920x1080
FPS: 83/12

Stream 1:
Return Code: 0

Video:

Codec: H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
Resolution: 704x576
FPS: 5/1

----

Stream 0:
Return Code: 0

Video:

Codec: H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
Resolution: 3840x2160
FPS: 45/4

Stream 1:
Return Code: 0

Video:

Codec: H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
Resolution: 704x576
FPS: 5/1

Frigate stats

{"camxxx":{"camera_fps":5.1,"capture_pid":886,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":894,"pid":723,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":838,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":845,"pid":709,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":749,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":757,"pid":686,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":866,"detection_enabled":1,"detection_fps":1.1,"ffmpeg_pid":876,"pid":717,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":880,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":887,"pid":721,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":793,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":803,"pid":700,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.0,"capture_pid":730,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":735,"pid":678,"process_fps":5.0,"skipped_fps":0.0},"camxxx":{"camera_fps":5.0,"capture_pid":801,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":834,"pid":703,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":766,"detection_enabled":1,"detection_fps":0.1,"ffmpeg_pid":776,"pid":690,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.0,"capture_pid":893,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":907,"pid":726,"process_fps":5.0,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":734,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":743,"pid":681,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":774,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":790,"pid":691,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.0,"capture_pid":740,"detection_enabled":1,"detection_fps":5.0,"ffmpeg_pid":752,"pid":683,"process_fps":5.0,"skipped_fps":0.0},"camxxx":{"camera_fps":5.0,"capture_pid":758,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":770,"pid":688,"process_fps":5.0,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":861,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":869,"pid":714,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":846,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":854,"pid":711,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.0,"capture_pid":900,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":909,"pid":728,"process_fps":5.0,"skipped_fps":0.0},"camxxx":{"camera_fps":5.0,"capture_pid":855,"detection_enabled":1,"detection_fps":9.4,"ffmpeg_pid":862,"pid":713,"process_fps":5.0,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":873,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":881,"pid":720,"process_fps":5.1,"skipped_fps":0.0},"camxxx":{"camera_fps":5.0,"capture_pid":831,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":841,"pid":706,"process_fps":5.0,"skipped_fps":0.0},"camxxx":{"camera_fps":5.1,"capture_pid":781,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":792,"pid":694,"process_fps":5.1,"skipped_fps":0.0},"cpu_usages":{"%Cpu(s):":{"cpu":"id,","mem":"1.1"},"1":{"cpu":"0.0","mem":"0.0"},"1039787":{"cpu":"28.2","mem":"0.3"},"116":{"cpu":"0.0","mem":"0.0"},"134":{"cpu":"0.0","mem":"0.0"},"135":{"cpu":"0.0","mem":"0.0"},"136":{"cpu":"0.0","mem":"0.0"},"137":{"cpu":"0.0","mem":"0.0"},"148":{"cpu":"0.0","mem":"0.0"},"15":{"cpu":"0.0","mem":"0.0"},"1682340":{"cpu":"0.0","mem":"0.0"},"1683534":{"cpu":"0.0","mem":"0.0"},"1683622":{"cpu":"0.3","mem":"0.0"},"1683623":{"cpu":"6.7","mem":"0.0"},"1683624":{"cpu":"46.7","mem":"0.0"},"1683702":{"cpu":"1.0","mem":"0.0"},"1683707":{"cpu":"30.6","mem":"0.1"},"1683746":{"cpu":"0.0","mem":"0.0"},"17":{"cpu":"0.0","mem":"0.0"},"172":{"cpu":"0.0","mem":"0.0"},"199":{"cpu":"0.0","mem":"0.0"},"239":{"cpu":"0.0","mem":"0.0"},"24":{"cpu":"0.0","mem":"0.0"},"25":{"cpu":"0.0","mem":"0.0"},"26":{"cpu":"0.0","mem":"0.0"},"267":{"cpu":"0.0","mem":"0.0"},"27":{"cpu":"0.0","mem":"0.0"},"28":{"cpu":"0.0","mem":"0.0"},"29":{"cpu":"0.0","mem":"0.0"},"30":{"cpu":"0.0","mem":"0.0"},"303":{"cpu":"0.0","mem":"0.0"},"31":{"cpu":"0.0","mem":"0.0"},"32":{"cpu":"0.0","mem":"0.0"},"334":{"cpu":"0.0","mem":"0.0"},"369":{"cpu":"0.0","mem":"0.0"},"41":{"cpu":"0.0","mem":"0.0"},"42":{"cpu":"0.0","mem":"0.0"},"642":{"cpu":"0.0","mem":"0.1"},"666":{"cpu":"1.7","mem":"0.0"},"671":{"cpu":"48.2","mem":"0.1"},"678":{"cpu":"2.0","mem":"0.1"},"679":{"cpu":"0.0","mem":"0.0"},"681":{"cpu":"1.0","mem":"0.1"},"683":{"cpu":"13.0","mem":"0.1"},"684":{"cpu":"0.0","mem":"0.0"},"686":{"cpu":"5.0","mem":"0.1"},"687":{"cpu":"0.0","mem":"0.0"},"688":{"cpu":"1.3","mem":"0.1"},"689":{"cpu":"0.0","mem":"0.0"},"690":{"cpu":"1.7","mem":"0.1"},"691":{"cpu":"0.7","mem":"0.1"},"693":{"cpu":"0.0","mem":"0.0"},"694":{"cpu":"1.3","mem":"0.1"},"700":{"cpu":"1.3","mem":"0.1"},"701":{"cpu":"0.0","mem":"0.0"},"703":{"cpu":"1.3","mem":"0.1"},"705":{"cpu":"0.0","mem":"0.0"},"706":{"cpu":"1.0","mem":"0.1"},"708":{"cpu":"0.0","mem":"0.0"},"709":{"cpu":"1.3","mem":"0.1"},"711":{"cpu":"1.7","mem":"0.1"},"712":{"cpu":"0.0","mem":"0.0"},"713":{"cpu":"29.6","mem":"0.1"},"714":{"cpu":"1.3","mem":"0.1"},"715":{"cpu":"0.0","mem":"0.0"},"717":{"cpu":"1.0","mem":"0.1"},"719":{"cpu":"0.0","mem":"0.0"},"720":{"cpu":"1.3","mem":"0.1"},"721":{"cpu":"1.3","mem":"0.1"},"722":{"cpu":"0.0","mem":"0.0"},"723":{"cpu":"1.3","mem":"0.1"},"724":{"cpu":"0.0","mem":"0.0"},"726":{"cpu":"1.3","mem":"0.1"},"728":{"cpu":"1.3","mem":"0.1"},"729":{"cpu":"0.0","mem":"0.0"},"730":{"cpu":"2.0","mem":"0.1"},"731":{"cpu":"0.0","mem":"0.0"},"734":{"cpu":"1.7","mem":"0.1"},"735":{"cpu":"5.0","mem":"0.0"},"738":{"cpu":"0.0","mem":"0.0"},"740":{"cpu":"2.0","mem":"0.1"},"743":{"cpu":"5.0","mem":"0.0"},"747":{"cpu":"1.7","mem":"0.0"},"748":{"cpu":"0.0","mem":"0.0"},"749":{"cpu":"2.0","mem":"0.1"},"752":{"cpu":"5.0","mem":"0.0"},"755":{"cpu":"1.7","mem":"0.0"},"756":{"cpu":"0.0","mem":"0.0"},"757":{"cpu":"5.3","mem":"0.0"},"758":{"cpu":"2.0","mem":"0.1"},"765":{"cpu":"1.3","mem":"0.0"},"766":{"cpu":"2.0","mem":"0.1"},"769":{"cpu":"0.0","mem":"0.0"},"770":{"cpu":"5.3","mem":"0.0"},"771":{"cpu":"1.7","mem":"0.0"},"774":{"cpu":"2.0","mem":"0.1"},"776":{"cpu":"4.3","mem":"0.0"},"777":{"cpu":"0.0","mem":"0.0"},"781":{"cpu":"2.0","mem":"0.1"},"786":{"cpu":"2.0","mem":"0.0"},"789":{"cpu":"0.0","mem":"0.0"},"79":{"cpu":"0.0","mem":"0.0"},"790":{"cpu":"5.3","mem":"0.1"},"791":{"cpu":"1.3","mem":"0.0"},"792":{"cpu":"5.3","mem":"0.0"},"793":{"cpu":"2.0","mem":"0.1"},"800":{"cpu":"19.3","mem":"0.1"},"801":{"cpu":"1.7","mem":"0.1"},"802":{"cpu":"2.0","mem":"0.0"},"803":{"cpu":"5.3","mem":"0.0"},"804":{"cpu":"2.3","mem":"0.0"},"81":{"cpu":"0.0","mem":"0.0"},"82":{"cpu":"0.0","mem":"0.0"},"831":{"cpu":"2.0","mem":"0.1"},"834":{"cpu":"6.3","mem":"0.0"},"837":{"cpu":"0.7","mem":"0.0"},"838":{"cpu":"1.7","mem":"0.1"},"841":{"cpu":"4.7","mem":"0.0"},"844":{"cpu":"1.3","mem":"0.0"},"845":{"cpu":"5.0","mem":"0.0"},"846":{"cpu":"2.0","mem":"0.1"},"851":{"cpu":"0.3","mem":"0.0"},"854":{"cpu":"5.0","mem":"0.0"},"855":{"cpu":"1.7","mem":"0.1"},"856":{"cpu":"2.0","mem":"0.0"},"861":{"cpu":"2.0","mem":"0.1"},"862":{"cpu":"5.0","mem":"0.0"},"863":{"cpu":"2.0","mem":"0.0"},"866":{"cpu":"2.0","mem":"0.1"},"869":{"cpu":"4.7","mem":"0.0"},"872":{"cpu":"2.0","mem":"0.0"},"873":{"cpu":"2.0","mem":"0.1"},"876":{"cpu":"4.7","mem":"0.1"},"877":{"cpu":"1.3","mem":"0.0"},"880":{"cpu":"2.0","mem":"0.1"},"881":{"cpu":"4.7","mem":"0.0"},"886":{"cpu":"2.0","mem":"0.1"},"887":{"cpu":"4.3","mem":"0.0"},"888":{"cpu":"0.7","mem":"0.0"},"89":{"cpu":"87.4","mem":"0.0"},"893":{"cpu":"2.0","mem":"0.1"},"894":{"cpu":"6.3","mem":"0.0"},"895":{"cpu":"1.7","mem":"0.0"},"900":{"cpu":"1.7","mem":"0.1"},"901":{"cpu":"1.7","mem":"0.0"},"907":{"cpu":"6.0","mem":"0.0"},"908":{"cpu":"2.0","mem":"0.0"},"909":{"cpu":"4.7","mem":"0.0"},"914":{"cpu":"1.7","mem":"0.0"},"915":{"cpu":"1.3","mem":"0.0"},"97":{"cpu":"0.3","mem":"0.0"},"98":{"cpu":"15.6","mem":"0.3"},"MiB":{"cpu":"88634.7","mem":"avail"},"PID":{"cpu":"%CPU","mem":"%MEM"},"Tasks:":{"cpu":"stopped,","mem":"0"},"top":{"cpu":"users,","mem":"load"}},"detection_fps":15.6,"detectors":{"coral":{"detection_start":1690965162.68268,"inference_speed":35.42,"pid":1039787}},"service":{"last_updated":1690965165,"latest_version":"0.12.1","storage":{"/dev/shm":{"free":2075.6,"mount_type":"tmpfs","total":2147.5,"used":71.9},"/media/frigate/clips":{"free":18490869.5,"mount_type":"nfs4","total":23012434.8,"used":4521565.2},"/media/frigate/recordings":{"free":18490869.5,"mount_type":"nfs4","total":23012434.8,"used":4521565.2},"/tmp/cache":{"free":3862.2,"mount_type":"tmpfs","total":4000.0,"used":137.8}},"temperatures":{},"uptime":42726,"version":"0.12.1-367d724"}}

Operating system

Debian

Install method

Docker Compose

Coral version

USB

Network connection

Wired

Camera make and model

Most of them old Hikvision cameras, at least one newer Hikvision, ~5 new Dahua cameras.

Any other information that may be helpful

Bare metal server without GPU. Coral TPU accelerator works fine, max CPU usage I've seen is up to 50%. Resources usage of the host is acceptable, nothing is maxed out.

NickM-27 commented 1 year ago

This seems like an issue with the software h264 encoder being too slow. You could check the go2rtc config file in the go2rtc dashboard and adjust the parameters to see if it gets better.

Perhaps we should put a note in the docs that birdseye restream is only recommended when using hwaccel

erkexzcx commented 1 year ago

This seems like an issue with the software h264 encoder being too slow.

Thank you for your reply. If this were true, then all streams should be like this. jsmpeg however, works completelly fine.

To me, it sounds like an issue is somewhere else... 🤔

NickM-27 commented 1 year ago

This seems like an issue with the software h264 encoder being too slow.

Thank you for your reply. If this were true, then all streams should be like this. jsmpeg however, works completelly fine.

To me, it sounds like an issue is somewhere else... 🤔

No, that is incorrect. Jsmpeg is not encoded to h264 as it is just raw frames being sent via websocket

spacebares commented 1 year ago

Is there another device you can use to view the streams? Need to test if this is a device webbrowser problem or a frigate installation compatibility problem.

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.