search

blakeblackshear / frigate

NVR with realtime local object detection for IP cameras
https://frigate.video
MIT License
19.03k stars 1.74k forks source link

No frames have been received [Segmentation fault] #9192

Closed cliffjao closed 8 months ago

cliffjao commented 10 months ago

Describe the problem you are having

Cameras work great for a while, sometimes several days. But then they randomly get "No frames have been received, check error logs." Restarting Frigate brings the cameras back online... for a while.

The only logs I see after the most recent crash are segmentation faults.

Version

0.12.1-367D724

Frigate config file

logger:
  default: warning
  logs:
    frigate.app: warning
    frigate.mqtt: warning
    frigate.edgetpu: warning
    detector.coral: warning
    peewee: info

mqtt:
  # Required: host name
  host: REDACTED
  # Optional: port (default: shown below)
  port: 1883
  # Optional: topic prefix (default: shown below)
  # WARNING: must be unique if you are running multiple instances
  topic_prefix: frigate
  # Optional: client id (default: shown below)
  # WARNING: must be unique if you are running multiple instances
  client_id: frigate
  # Optional: user
  user: cliffj
  # Optional: password
  # NOTE: Environment variables that begin with 'FRIGATE_' may be referenced in {}.
  #       eg. password: '{FRIGATE_MQTT_PASSWORD}'
  password: REDACTED
  # Optional: interval in seconds for publishing stats (default: shown below)
  stats_interval: 60

ffmpeg:
  hwaccel_args: preset-intel-qsv-h264
  output_args:
    record: -f segment -segment_time 60 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy

motion:
  contour_area: 50

cameras:
  front_porch_cam:
    ffmpeg:
      inputs:
        - path: rtsp://REDACTED/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://REDACTED/
          roles:
            - record
    detect:
      width: 704 # for detect
      height: 480
    rtmp:
      enabled: False
    record:
      enabled: True
      retain:
        days: 14
      events:
        retain:
          default: 14
    snapshots:
      enabled: True
      bounding_box: True
    objects:
      track:
        - person
        - car
      filters:
        car:
          mask: 187,480,280,480,258,282,704,337,558,225,321,140,231,129,239,50,151,50
    zones:
      front_porch:
        coordinates: 187,480,280,480,258,282,429,291,637,435,704,375,609,315,521,253,322,170,231,129,228,49,151,50
        objects:
          - person
            #motion:
            #mask:
            #- 476,166,704,299,704,146,499,117
            #- 242,56,312,72,300,96,241,86
  driveway_cam:
    ffmpeg:
      inputs:
        - path: rtsp://REDACTED/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://REDACTED/
          roles:
            - record
    detect:
      width: 704 # for detect
      height: 480
      stationary:
        threshold: 5
    rtmp:
      enabled: False
    record:
      enabled: True
      retain:
        days: 14
      events:
        retain:
          default: 14
    snapshots:
      enabled: True
      bounding_box: True
    objects:
      filters:
        person:
          max_area: 10000
          min_area: 100
          min_score: 0.6
        car:
          max_area: 70000
          min_area: 500
    zones:
      driveway:
        coordinates: 0,221,0,344,0,480,353,480,435,354,204,275
        filters:
          person:
            max_area: 30000
            min_area: 1000
            min_score: 0.6
          car:
            max_area: 200000
            min_area: 20000
          dog:
            max_area: 10000
            min_area: 100
      street:
        coordinates: 147,139,208,120,427,96,704,145,704,300,190,199
  backyard_cam:
    ffmpeg:
      inputs:
        - path: rtsp://REDACTED/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://REDACTED/
          roles:
            - record
    detect:
      width: 704 # for detect
      height: 480
    rtmp:
      enabled: False
    record:
      enabled: True
      retain:
        days: 14
      events:
        retain:
          default: 14
    snapshots:
      enabled: True
      bounding_box: True
    zones:
      backyard:
        coordinates: 161,480,704,480,704,194,653,142,471,39,261,49,40,127
    objects:
      track:
        - person
  side_cam:
    ffmpeg:
      inputs:
        - path: rtsp://REDACTED/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://REDACTED/
          roles:
            - record
    detect:
      width: 704 # for detect
      height: 480
    rtmp:
      enabled: False
    record:
      enabled: True
      retain:
        days: 14
      events:
        retain:
          default: 14
    snapshots:
      enabled: True
      bounding_box: True
    zones:
      side:
        coordinates: 190,480,704,480,704,353,323,255,198,184,107,226
    motion:
      mask: 704,0,60,0,86,166,198,145,704,282
    objects:
      track:
        - person

go2rtc:
  streams:
    front_porch_cam: rtsp://REDACTED/
    driveway_cam: rtsp://REDACTED/
    backyard_cam: rtsp://REDACTED/
    side_cam: rtsp://REDACTED/

detectors:
  coral:
    type: edgetpu
    device: usb

objects:
  track:
    - person
    - bicycle
    - car
    - motorcycle
    - bus
    - boat
    - cat
    - dog
  filters:
    person:
      max_area: 30000
      min_area: 500
      min_score: 0.6
    car:
      max_area: 70000
      min_area: 500
    dog:
      max_area: 10000
      min_area: 100

Relevant log output

2024-01-03 05:12:11.258036134    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258039287    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258040831    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258042343    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258043727  
2024-01-03 05:12:11.258045089  Thread 0x00007fdfc9df76c0 (most recent call first):
2024-01-03 05:12:11.258046491    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258047991    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258049540    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258050956    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258052005  
2024-01-03 05:12:11.258053340  Thread 0x00007fdfcc5f86c0 (most recent call first):
2024-01-03 05:12:11.258054654    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258056170    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258057767    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258059246    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258060456  
2024-01-03 05:12:11.258061870  Thread 0x00007fdfccdf96c0 (most recent call first):
2024-01-03 05:12:11.258063365    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258064808    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258066324    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258067745    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258068885  
2024-01-03 05:12:11.258070258  Thread 0x00007fdfcf5fa6c0 (most recent call first):
2024-01-03 05:12:11.258071701    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.258073116    File "/usr/lib/python3.9/socketserver.py", line 232 in serve_forever
2024-01-03 05:12:11.258074524    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-01-03 05:12:11.258076009    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258077425    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258078465  
2024-01-03 05:12:11.258079807  Current thread 0x00007fdfd9d306c0 (most recent call first):
2024-01-03 05:12:11.258081217    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 141 in poll
2024-01-03 05:12:11.258082732    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 312 in run
2024-01-03 05:12:11.258084174    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258085559    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258086665  
2024-01-03 05:12:11.258087958  Thread 0x00007fdfde19a740 (most recent call first):
2024-01-03 05:12:11.258089366    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.258090768    File "/usr/lib/python3.9/multiprocessing/connection.py", line 936 in wait
2024-01-03 05:12:11.258092285    File "/usr/lib/python3.9/multiprocessing/connection.py", line 429 in _poll
2024-01-03 05:12:11.258093736    File "/usr/lib/python3.9/multiprocessing/connection.py", line 262 in poll
2024-01-03 05:12:11.258095256    File "/usr/lib/python3.9/multiprocessing/queues.py", line 113 in get
2024-01-03 05:12:11.258096709    File "/opt/frigate/frigate/output.py", line 483 in output_frames
2024-01-03 05:12:11.258098130    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-01-03 05:12:11.258099612    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-01-03 05:12:11.258101097    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-01-03 05:12:11.258102594    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-01-03 05:12:11.258104021    File "/usr/lib/python3.9/multiprocessing/context.py", line 277 in _Popen
2024-01-03 05:12:11.258105525    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-01-03 05:12:11.258124853    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-01-03 05:12:11.258126452    File "/opt/frigate/frigate/app.py", line 245 in start_video_output_processor
2024-01-03 05:12:11.258132941    File "/opt/frigate/frigate/app.py", line 380 in start
2024-01-03 05:12:11.258172978    File "/opt/frigate/frigate/__main__.py", line 16 in <module>
2024-01-03 05:12:11.258211019    File "/usr/lib/python3.9/runpy.py", line 87 in _run_code
2024-01-03 05:12:11.258256387    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-01-03 05:12:11.258274549  Fatal Python error: Segmentation fault
2024-01-03 05:12:11.258275674  
2024-01-03 05:12:11.258277056  Thread 0x00007fdfd45fc6c0 (most recent call first):
2024-01-03 05:12:11.258308617    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258346398    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258394378    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258437281    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258443988  
2024-01-03 05:12:11.258445436  Thread 0x00007fdfd6dfd6c0 (most recent call first):
2024-01-03 05:12:11.258477185    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258511394    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258561083    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258605676    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258606783  
2024-01-03 05:12:11.258613048  Thread 0x00007fdfc9df76c0 (most recent call first):
2024-01-03 05:12:11.258644196    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258679059    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258724796    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258766756    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258767900  
2024-01-03 05:12:11.258774505  Thread 0x00007fdfcc5f86c0 (most recent call first):
2024-01-03 05:12:11.258794595    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258820115    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258856287    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.258887693    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.258888797  
2024-01-03 05:12:11.258894940  Thread 0x00007fdfccdf96c0 (most recent call first):
2024-01-03 05:12:11.258915362    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.258939600    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.258973501    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.259004206    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.259010064  
2024-01-03 05:12:11.259011491  Thread 0x00007fdfcf5fa6c0 (most recent call first):
2024-01-03 05:12:11.259034408    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.259070845    File "/usr/lib/python3.9/socketserver.py", line 232 in serve_forever
2024-01-03 05:12:11.259099937    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-01-03 05:12:11.259134170    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.259167652    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.259168775  
2024-01-03 05:12:11.259175281  Current thread 0x00007fdfd9d306c0 (most recent call first):
2024-01-03 05:12:11.259211670    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 141 in poll
2024-01-03 05:12:11.259255016    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 312 in run
2024-01-03 05:12:11.259290896    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.259320598    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.259321720  
2024-01-03 05:12:11.259328330  Thread 0x00007fdfde19a740 (most recent call first):
2024-01-03 05:12:11.259347908    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.259387362    File "/usr/lib/python3.9/multiprocessing/connection.py", line 936 in wait
2024-01-03 05:12:11.259426165    File "/usr/lib/python3.9/multiprocessing/connection.py", line 429 in _poll
2024-01-03 05:12:11.259463520    File "/usr/lib/python3.9/multiprocessing/connection.py", line 262 in poll
2024-01-03 05:12:11.259499101    File "/usr/lib/python3.9/multiprocessing/queues.py", line 113 in get
2024-01-03 05:12:11.259534585    File "/opt/frigate/frigate/output.py", line 483 in output_frames
2024-01-03 05:12:11.259574305    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-01-03 05:12:11.259620185    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-01-03 05:12:11.259665076    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-01-03 05:12:11.259708632    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-01-03 05:12:11.259748768    File "/usr/lib/python3.9/multiprocessing/context.py", line 277 in _Popen
2024-01-03 05:12:11.259801926    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-01-03 05:12:11.259845145    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-01-03 05:12:11.259891596    File "/opt/frigate/frigate/app.py", line 245 in start_video_output_processor
2024-01-03 05:12:11.259915908    File "/opt/frigate/frigate/app.py", line 380 in start
2024-01-03 05:12:11.259948518    File "/opt/frigate/frigate/__main__.py", line 16 in <module>
2024-01-03 05:12:11.259979869    File "/usr/lib/python3.9/runpy.py", line 87 in _run_code
2024-01-03 05:12:11.260019238    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-01-03 05:12:11.260035119  Fatal Python error: Segmentation fault
2024-01-03 05:12:11.260036231  
2024-01-03 05:12:11.260037597  Thread 0x00007fdfd45fc6c0 (most recent call first):
2024-01-03 05:12:11.260057713    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.260085631    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.260121285    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.260152829    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.260153954  
2024-01-03 05:12:11.260161586  Thread 0x00007fdfd6dfd6c0 (most recent call first):
2024-01-03 05:12:11.260177071    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.260200461    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.260234432    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.260266110    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.260272266  
2024-01-03 05:12:11.260273700  Thread 0x00007fdfc9df76c0 (most recent call first):
2024-01-03 05:12:11.260293913    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.260319780    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.260354053    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.260385224    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.260386402  
2024-01-03 05:12:11.260393407  Thread 0x00007fdfcc5f86c0 (most recent call first):
2024-01-03 05:12:11.260409863    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.260434965    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.260468983    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.260498608    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.260505204  
2024-01-03 05:12:11.260506695  Thread 0x00007fdfccdf96c0 (most recent call first):
2024-01-03 05:12:11.260523470    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.260548909    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.260581285    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.260613050    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.260614215  
2024-01-03 05:12:11.260620986  Thread 0x00007fdfcf5fa6c0 (most recent call first):
2024-01-03 05:12:11.260643021    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.260675529    File "/usr/lib/python3.9/socketserver.py", line 232 in serve_forever
2024-01-03 05:12:11.260698065    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-01-03 05:12:11.260730356    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.260756251    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.260758021  
2024-01-03 05:12:11.260767242  Current thread 0x00007fdfd9d306c0 (most recent call first):
2024-01-03 05:12:11.260794959    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 141 in poll
2024-01-03 05:12:11.260835497    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 312 in run
2024-01-03 05:12:11.260865396    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.260896188    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.260898028  
2024-01-03 05:12:11.260907727  Thread 0x00007fdfde19a740 (most recent call first):
2024-01-03 05:12:11.260918679    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.260956166    File "/usr/lib/python3.9/multiprocessing/connection.py", line 936 in wait
2024-01-03 05:12:11.260990653    File "/usr/lib/python3.9/multiprocessing/connection.py", line 429 in _poll
2024-01-03 05:12:11.261026900    File "/usr/lib/python3.9/multiprocessing/connection.py", line 262 in poll
2024-01-03 05:12:11.261056935    File "/usr/lib/python3.9/multiprocessing/queues.py", line 113 in get
2024-01-03 05:12:11.261088781    File "/opt/frigate/frigate/output.py", line 483 in output_frames
2024-01-03 05:12:11.261119307    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-01-03 05:12:11.261171047    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-01-03 05:12:11.261218704    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-01-03 05:12:11.261275711    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-01-03 05:12:11.261328761    File "/usr/lib/python3.9/multiprocessing/context.py", line 277 in _Popen
2024-01-03 05:12:11.261376281    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-01-03 05:12:11.261424005    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-01-03 05:12:11.261477695    File "/opt/frigate/frigate/app.py", line 245 in start_video_output_processor
2024-01-03 05:12:11.261511580    File "/opt/frigate/frigate/app.py", line 380 in start
2024-01-03 05:12:11.261546469    File "/opt/frigate/frigate/__main__.py", line 16 in <module>
2024-01-03 05:12:11.261579830    File "/usr/lib/python3.9/runpy.py", line 87 in _run_code
2024-01-03 05:12:11.261623700    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-01-03 05:12:11.261650453  Fatal Python error: Segmentation fault
2024-01-03 05:12:11.261652170  
2024-01-03 05:12:11.261654285  Thread 0x00007fdfd45fc6c0 (most recent call first):
2024-01-03 05:12:11.261676546    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.261704364    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.261751868    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.261788290    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.261795843  
2024-01-03 05:12:11.261798222  Thread 0x00007fdfd6dfd6c0 (most recent call first):
2024-01-03 05:12:11.261824054    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.261857219    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.261899648    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.261936392    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.261938205  
2024-01-03 05:12:11.261946251  Thread 0x00007fdfc9df76c0 (most recent call first):
2024-01-03 05:12:11.261967846    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.261997721    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.262040137    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.262083347    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.262085083  
2024-01-03 05:12:11.262093336  Thread 0x00007fdfcc5f86c0 (most recent call first):
2024-01-03 05:12:11.262115689    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.262150174    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.262197660    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.262238221    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.262246698  
2024-01-03 05:12:11.262248864  Thread 0x00007fdfccdf96c0 (most recent call first):
2024-01-03 05:12:11.262271239    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.262307847    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.262354078    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.262395714    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.262397460  
2024-01-03 05:12:11.262406422  Thread 0x00007fdfcf5fa6c0 (most recent call first):
2024-01-03 05:12:11.262430783    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.262477820    File "/usr/lib/python3.9/socketserver.py", line 232 in serve_forever
2024-01-03 05:12:11.262507997    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-01-03 05:12:11.262552258    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.262593940    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.262595755  
2024-01-03 05:12:11.262606741  Current thread 0x00007fdfd9d306c0 (most recent call first):
2024-01-03 05:12:11.262652897    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 141 in poll
2024-01-03 05:12:11.262709890    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 312 in run
2024-01-03 05:12:11.262756055    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.262797844    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.262799546  
2024-01-03 05:12:11.262808665  Thread 0x00007fdfde19a740 (most recent call first):
2024-01-03 05:12:11.262836532    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.262886060    File "/usr/lib/python3.9/multiprocessing/connection.py", line 936 in wait
2024-01-03 05:12:11.262937128    File "/usr/lib/python3.9/multiprocessing/connection.py", line 429 in _poll
2024-01-03 05:12:11.262988612    File "/usr/lib/python3.9/multiprocessing/connection.py", line 262 in poll
2024-01-03 05:12:11.263030653    File "/usr/lib/python3.9/multiprocessing/queues.py", line 113 in get
2024-01-03 05:12:11.263070901    File "/opt/frigate/frigate/output.py", line 483 in output_frames
2024-01-03 05:12:11.263116329    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-01-03 05:12:11.263170146    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-01-03 05:12:11.263220047    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-01-03 05:12:11.263274889    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-01-03 05:12:11.263321901    File "/usr/lib/python3.9/multiprocessing/context.py", line 277 in _Popen
2024-01-03 05:12:11.263371917    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-01-03 05:12:11.263422470    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-01-03 05:12:11.263475593    File "/opt/frigate/frigate/app.py", line 245 in start_video_output_processor
2024-01-03 05:12:11.263505958    File "/opt/frigate/frigate/app.py", line 380 in start
2024-01-03 05:12:11.263545483    File "/opt/frigate/frigate/__main__.py", line 16 in <module>
2024-01-03 05:12:11.263581900    File "/usr/lib/python3.9/runpy.py", line 87 in _run_code
2024-01-03 05:12:11.263626375    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-01-03 05:12:11.263647370  Fatal Python error: Segmentation fault
2024-01-03 05:12:11.263649175  
2024-01-03 05:12:11.263651432  Thread 0x00007fdfd45fc6c0 (most recent call first):
2024-01-03 05:12:11.263677973    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.263712940    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.263770202    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.263807932    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.263816304  
2024-01-03 05:12:11.263818355  Thread 0x00007fdfd6dfd6c0 (most recent call first):
2024-01-03 05:12:11.263841936    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.263872974    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.263915858    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.263957615    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.263959455  
2024-01-03 05:12:11.263968416  Thread 0x00007fdfc9df76c0 (most recent call first):
2024-01-03 05:12:11.263990925    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.264024614    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.264069765    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.264111801    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.264113677  
2024-01-03 05:12:11.264122963  Thread 0x00007fdfcc5f86c0 (most recent call first):
2024-01-03 05:12:11.264150831    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.264187973    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.264236156    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.264279068    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.264280760  
2024-01-03 05:12:11.264289874  Thread 0x00007fdfccdf96c0 (most recent call first):
2024-01-03 05:12:11.264318060    File "/opt/frigate/frigate/output.py", line 111 in read
2024-01-03 05:12:11.264355214    File "/opt/frigate/frigate/output.py", line 137 in run
2024-01-03 05:12:11.264404238    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.264449483    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.264457730  
2024-01-03 05:12:11.264460166  Thread 0x00007fdfcf5fa6c0 (most recent call first):
2024-01-03 05:12:11.264491967    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.264542684    File "/usr/lib/python3.9/socketserver.py", line 232 in serve_forever
2024-01-03 05:12:11.264578131    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-01-03 05:12:11.264629917    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.264674380    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.264676177  
2024-01-03 05:12:11.264685363  Current thread 0x00007fdfd9d306c0 (most recent call first):
2024-01-03 05:12:11.264734729    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 141 in poll
2024-01-03 05:12:11.264795453    File "/usr/local/lib/python3.9/dist-packages/ws4py/manager.py", line 312 in run
2024-01-03 05:12:11.264842057    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-03 05:12:11.264886933    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-03 05:12:11.264888888  
2024-01-03 05:12:11.264898204  Thread 0x00007fdfde19a740 (most recent call first):
2024-01-03 05:12:11.264928690    File "/usr/lib/python3.9/selectors.py", line 416 in select
2024-01-03 05:12:11.264984529    File "/usr/lib/python3.9/multiprocessing/connection.py", line 936 in wait
2024-01-03 05:12:11.265040023    File "/usr/lib/python3.9/multiprocessing/connection.py", line 429 in _poll
2024-01-03 05:12:11.265094455    File "/usr/lib/python3.9/multiprocessing/connection.py", line 262 in poll
2024-01-03 05:12:11.265143568    File "/usr/lib/python3.9/multiprocessing/queues.py", line 113 in get
2024-01-03 05:12:11.265189645    File "/opt/frigate/frigate/output.py", line 483 in output_frames
2024-01-03 05:12:11.265240428    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-01-03 05:12:11.265300849    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-01-03 05:12:11.265362276    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-01-03 05:12:11.265417974    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-01-03 05:12:11.265470644    File "/usr/lib/python3.9/multiprocessing/context.py", line 277 in _Popen
2024-01-03 05:12:11.265526233    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-01-03 05:12:11.265577323    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-01-03 05:12:11.265637149    File "/opt/frigate/frigate/app.py", line 245 in start_video_output_processor
2024-01-03 05:12:11.265671944    File "/opt/frigate/frigate/app.py", line 380 in start
2024-01-03 05:12:11.265715037    File "/opt/frigate/frigate/__main__.py", line 16 in <module>
2024-01-03 05:12:11.265754021    File "/usr/lib/python3.9/runpy.py", line 87 in _run_code
2024-01-03 05:12:11.265802594    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-01-03 05:12:11.265815245  Fatal Python error: Segmentation fault

[Lines above repeat a lot of times]

FFprobe output from your camera

N/A

Frigate stats

No response

Operating system

HassOS

Install method

HassOS Addon

Coral version

USB

Network connection

Wired

Camera make and model

Lorex E891AB

Any other information that may be helpful

No response

NickM-27 commented 10 months ago

Need to see the full lot from the beginning of the crash.

cliffjao commented 10 months ago

Need to see the full lot from the beginning of the crash.

What I pasted is from the beginning of the logs. I think those messages repeated so many times that the log buffer ran out. I had to trim the logs after the first few seg faults in order to be able to submit this ticket.

cliffjao commented 10 months ago

See 2024-01-03 05:12:11.258277056 for the start of a full trace.

cliffjao commented 10 months ago

After restarting Frigate, yesterday, another camera started having the same issue again. Here are the logs, where you'll see the same Segmentation Fault:

2024-01-03 23:14:43.443360553  [INFO] Starting Frigate...
2024-01-03 23:14:46.217022956  [2024-01-03 23:14:46] frigate.app                    INFO    : Starting Frigate (0.12.1-367d724)
2024-01-03 23:14:48.351996554  [2024-01-03 23:14:48] frigate.util                   ERROR   : Unable to poll intel GPU stats: Failed to initialize PMU! (Permission denied)
2024-01-03 23:14:48.352001528  
2024-01-03 23:15:57.053933341  [2024-01-03 23:15:57] frigate.util                   ERROR   : Unable to poll intel GPU stats: Failed to initialize PMU! (Permission denied)
2024-01-03 23:15:57.053941754  
2024-01-04 01:51:56.259511853  Fatal Python error: Segmentation fault
2024-01-04 01:51:56.259650287  
2024-01-04 01:51:56.259658519  Thread 0x00007fe397ff86c0 (most recent call first):
2024-01-04 01:51:56.260309171    File "/usr/lib/python3.9/threading.py", line 312 in wait
2024-01-04 01:51:56.260427059    File "/usr/lib/python3.9/multiprocessing/queues.py", line 233 in _feed
2024-01-04 01:51:56.260536604    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-01-04 01:51:56.260622166    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-04 01:51:56.260725534    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-04 01:51:56.260729900  
2024-01-04 01:51:56.260751007  Thread 0x00007fe39a7f96c0 (most recent call first):
2024-01-04 01:51:56.260816481    File "/opt/frigate/frigate/log.py", line 86 in run
2024-01-04 01:51:56.260918691    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-04 01:51:56.262836580    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-04 01:51:56.262844843  
2024-01-04 01:51:56.262850951  Current thread 0x00007fe39cffa6c0 (most recent call first):
2024-01-04 01:51:56.262856548    File "/opt/frigate/frigate/util.py", line 667 in <listcomp>
2024-01-04 01:51:56.262871686    File "/opt/frigate/frigate/util.py", line 667 in eps
2024-01-04 01:51:56.262877906    File "/opt/frigate/frigate/video.py", line 172 in capture_frames
2024-01-04 01:51:56.262946510    File "/opt/frigate/frigate/video.py", line 394 in run
2024-01-04 01:51:56.262954661    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-04 01:51:56.262962936    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-04 01:51:56.262968191  
2024-01-04 01:51:56.262975231  Thread 0x00007fe3a772b6c0 (most recent call first):
2024-01-04 01:51:56.263058194    File "/usr/lib/python3.9/multiprocessing/synchronize.py", line 261 in wait
2024-01-04 01:51:56.263065106    File "/usr/lib/python3.9/multiprocessing/synchronize.py", line 349 in wait
2024-01-04 01:51:56.263071660    File "/opt/frigate/frigate/video.py", line 253 in run
2024-01-04 01:51:56.263076907    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-04 01:51:56.263136431    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-04 01:51:56.263141298  
2024-01-04 01:51:56.263146823  Thread 0x00007fe3a47fd6c0 (most recent call first):
2024-01-04 01:51:56.263152707    File "/opt/frigate/frigate/log.py", line 86 in run
2024-01-04 01:51:56.263158312    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-01-04 01:51:56.263163838    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-01-04 01:51:56.263169663  
2024-01-04 01:51:56.263175209  Thread 0x00007fe3aba85740 (most recent call first):
2024-01-04 01:51:56.263181118    File "/usr/lib/python3.9/threading.py", line 1049 in _wait_for_tstate_lock
2024-01-04 01:51:56.263186538    File "/usr/lib/python3.9/threading.py", line 1033 in join
2024-01-04 01:51:56.263242120    File "/opt/frigate/frigate/video.py", line 429 in capture_camera
2024-01-04 01:51:56.263248918    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-01-04 01:51:56.263254688    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-01-04 01:51:56.263319759    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-01-04 01:51:56.263470471    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-01-04 01:51:56.263477846    File "/usr/lib/python3.9/multiprocessing/context.py", line 277 in _Popen
2024-01-04 01:51:56.263483817    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-01-04 01:51:56.263489272    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-01-04 01:51:56.263494746    File "/opt/frigate/frigate/app.py", line 286 in start_camera_capture_processes
2024-01-04 01:51:56.263499789    File "/opt/frigate/frigate/app.py", line 383 in start
2024-01-04 01:51:56.263505293    File "/opt/frigate/frigate/__main__.py", line 16 in <module>
2024-01-04 01:51:56.263603707    File "/usr/lib/python3.9/runpy.py", line 87 in _run_code
2024-01-04 01:51:56.263678621    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-01-04 02:17:11.203145815  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-01-04 02:17:11.203352401  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [mp4 @ 0x563d9469ef00] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-01-04 02:17:11.203361589  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [mp4 @ 0x563d9469ef00] pts has no value
2024-01-04 02:17:11.203371197  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:0; previous: 4484, current: 4484; changing to 4485. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.203379984  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:0; previous: 4485, current: 4484; changing to 4486. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.203389008  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:0; previous: 4486, current: 4484; changing to 4487. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.203397833  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:0; previous: 4487, current: 4484; changing to 4488. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.206592961  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:0; previous: 4488, current: 4484; changing to 4489. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.206871320  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:0; previous: 4489, current: 4484; changing to 4490. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.207175397  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333278, current: 22333276; changing to 22333279. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209903019  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333279, current: 22333276; changing to 22333280. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209918416  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333280, current: 22333277; changing to 22333281. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209928371  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333281, current: 22333277; changing to 22333282. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209937101  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333282, current: 22333277; changing to 22333283. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209946330  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333283, current: 22333277; changing to 22333284. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209955109  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333284, current: 22333277; changing to 22333285. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209964371  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333285, current: 22333277; changing to 22333286. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209973095  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333286, current: 22333278; changing to 22333287. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209982166  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333287, current: 22333278; changing to 22333288. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.209990882  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333288, current: 22333278; changing to 22333289. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.210004376  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333289, current: 22333278; changing to 22333290. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.210077637  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333290, current: 22333278; changing to 22333291. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.210291921  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333291, current: 22333278; changing to 22333292. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.210897954  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333292, current: 22333278; changing to 22333293. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.211569434  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333293, current: 22333279; changing to 22333294. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.212355718  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333294, current: 22333279; changing to 22333295. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.212892339  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333295, current: 22333279; changing to 22333296. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.213615380  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333296, current: 22333279; changing to 22333297. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.214158958  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333297, current: 22333279; changing to 22333298. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.214730570  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333298, current: 22333279; changing to 22333299. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.214991787  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333299, current: 22333279; changing to 22333300. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.215583261  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333300, current: 22333280; changing to 22333301. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.215979351  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333301, current: 22333280; changing to 22333302. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.216646462  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333302, current: 22333280; changing to 22333303. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.216883340  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333303, current: 22333280; changing to 22333304. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.217219487  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333304, current: 22333280; changing to 22333305. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.217643697  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333305, current: 22333280; changing to 22333306. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.218309794  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333306, current: 22333280; changing to 22333307. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.218883430  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333307, current: 22333283; changing to 22333308. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.219490737  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333308, current: 22333284; changing to 22333309. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.219977278  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333309, current: 22333284; changing to 22333310. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.220431048  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333310, current: 22333285; changing to 22333311. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.221135038  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333311, current: 22333285; changing to 22333312. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.221652979  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333312, current: 22333286; changing to 22333313. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.221988731  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333313, current: 22333286; changing to 22333314. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.223203400  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333314, current: 22333287; changing to 22333315. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.223452261  [2024-01-04 02:17:11] ffmpeg.side_cam.record         ERROR   : [segment @ 0x563d9469f840] Non-monotonous DTS in output stream 0:1; previous: 22333315, current: 22333287; changing to 22333316. This may result in incorrect timestamps in the output file.
2024-01-04 02:17:11.393268844  [2024-01-04 02:17:11] frigate.record                 WARNING : Failed to probe corrupt segment /tmp/cache/side_cam-20240104021648.mp4: 0 - b'[mov,mp4,m4a,3gp,3g2,mj2 @ 0x558bbb0b76c0] moov atom not found\n/tmp/cache/side_cam-20240104021648.mp4: Invalid data found when processing input\n'
2024-01-04 02:17:11.393304768  [2024-01-04 02:17:11] frigate.record                 WARNING : Discarding a corrupt recording segment: /tmp/cache/side_cam-20240104021648.mp4
2024-01-04 02:31:43.516636739  [2024-01-04 02:31:43] frigate.video                  ERROR   : driveway_cam: Unable to read frames from ffmpeg process.
2024-01-04 02:31:43.516703572  [2024-01-04 02:31:43] frigate.video                  ERROR   : driveway_cam: Unable to read frames from ffmpeg process.
2024-01-04 02:31:43.516707036  [2024-01-04 02:31:43] frigate.video                  ERROR   : driveway_cam: ffmpeg process is not running. exiting capture thread...
2024-01-04 02:31:51.413423215  [2024-01-04 02:31:51] watchdog.driveway_cam          ERROR   : Ffmpeg process crashed unexpectedly for driveway_cam.
2024-01-04 02:31:51.413537533  [2024-01-04 02:31:51] watchdog.driveway_cam          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-01-04 02:41:23.350193390  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-01-04 02:41:23.351481974  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [mp4 @ 0x556f38ae7400] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-01-04 02:41:23.351673357  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [mp4 @ 0x556f38ae7400] pts has no value
2024-01-04 02:41:23.351808316  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:0; previous: 9387, current: 9387; changing to 9388. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.351910206  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:0; previous: 9388, current: 9387; changing to 9389. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352006403  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:0; previous: 9389, current: 9387; changing to 9390. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352096824  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:0; previous: 9390, current: 9387; changing to 9391. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352181876  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:0; previous: 9391, current: 9387; changing to 9392. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352257382  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:0; previous: 9392, current: 9387; changing to 9393. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352363281  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332729, current: 22332727; changing to 22332730. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352466385  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332738, current: 22332736; changing to 22332739. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352555992  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332739, current: 22332737; changing to 22332740. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352648763  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332740, current: 22332737; changing to 22332741. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352739820  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332741, current: 22332737; changing to 22332742. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352832065  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332742, current: 22332739; changing to 22332743. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.352916892  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332743, current: 22332740; changing to 22332744. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353073474  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332744, current: 22332741; changing to 22332745. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353078285  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332745, current: 22332742; changing to 22332746. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353169833  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332746, current: 22332742; changing to 22332747. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353252757  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332747, current: 22332743; changing to 22332748. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353330881  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332748, current: 22332743; changing to 22332749. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353410237  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332749, current: 22332743; changing to 22332750. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353490655  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332750, current: 22332743; changing to 22332751. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353571820  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332751, current: 22332744; changing to 22332752. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353650961  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332752, current: 22332744; changing to 22332753. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353736021  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332753, current: 22332744; changing to 22332754. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353822641  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332754, current: 22332744; changing to 22332755. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353900287  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332755, current: 22332745; changing to 22332756. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.353986872  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332756, current: 22332745; changing to 22332757. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354075367  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332757, current: 22332746; changing to 22332758. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354171039  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332758, current: 22332746; changing to 22332759. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354258493  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332759, current: 22332746; changing to 22332760. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354347110  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332760, current: 22332746; changing to 22332761. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354435049  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332761, current: 22332747; changing to 22332762. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354521216  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332762, current: 22332748; changing to 22332763. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354622447  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332763, current: 22332748; changing to 22332764. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354705889  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332764, current: 22332749; changing to 22332765. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354789923  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332765, current: 22332750; changing to 22332766. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354891332  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332766, current: 22332751; changing to 22332767. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.354977147  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332767, current: 22332756; changing to 22332768. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.355054960  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332768, current: 22332757; changing to 22332769. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.355153764  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332769, current: 22332758; changing to 22332770. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.355240896  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332770, current: 22332759; changing to 22332771. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.355329028  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332771, current: 22332760; changing to 22332772. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.355631605  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332772, current: 22332761; changing to 22332773. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.355635777  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332773, current: 22332762; changing to 22332774. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.355639729  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332774, current: 22332763; changing to 22332775. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.355643371  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332775, current: 22332763; changing to 22332776. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.361413926  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : [segment @ 0x556f38ae2f00] Non-monotonous DTS in output stream 0:1; previous: 22332776, current: 22332764; changing to 22332777. This may result in incorrect timestamps in the output file.
2024-01-04 02:41:23.361642739  [2024-01-04 02:41:23] ffmpeg.backyard_cam.record     ERROR   : rtsp://*:*@192.168.101.183/: Connection timed out
2024-01-04 02:41:38.639969684  [2024-01-04 02:41:38] frigate.video                  ERROR   : backyard_cam: Unable to read frames from ffmpeg process.
2024-01-04 02:41:38.640084821  [2024-01-04 02:41:38] frigate.video                  ERROR   : backyard_cam: ffmpeg process is not running. exiting capture thread...
2024-01-04 02:41:38.664762043  [2024-01-04 02:41:38] ffmpeg.backyard_cam.record     ERROR   : [tcp @ 0x55dd719f6180] Connection to tcp://192.168.101.183:554?timeout=5000000 failed: Connection timed out
2024-01-04 02:41:38.665193333  [2024-01-04 02:41:38] ffmpeg.backyard_cam.record     ERROR   : rtsp://*:*@192.168.101.183/: Connection timed out
2024-01-04 02:41:48.690566616  [2024-01-04 02:41:48] watchdog.backyard_cam          ERROR   : Ffmpeg process crashed unexpectedly for backyard_cam.
2024-01-04 02:41:48.690679427  [2024-01-04 02:41:48] watchdog.backyard_cam          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-01-04 02:41:48.690686477  [2024-01-04 02:41:48] ffmpeg.backyard_cam.detect     ERROR   : rtsp://*:*@192.168.101.183/cam/realmonitor?channel=1&subtype=1: Connection timed out
2024-01-04 02:41:48.690690847  [2024-01-04 02:41:48] ffmpeg.backyard_cam.detect     ERROR   :     Last message repeated 4 times
2024-01-04 02:41:48.720006788  [2024-01-04 02:41:48] ffmpeg.backyard_cam.record     ERROR   : [tcp @ 0x5627e6889180] Connection to tcp://192.168.101.183:554?timeout=5000000 failed: Connection refused
2024-01-04 02:41:48.720138315  [2024-01-04 02:41:48] ffmpeg.backyard_cam.record     ERROR   : rtsp://*:*@192.168.101.183/: Connection refused
2024-01-04 02:41:48.898753181  [2024-01-04 02:41:48] frigate.video                  ERROR   : backyard_cam: Unable to read frames from ffmpeg process.
2024-01-04 02:41:48.899278780  [2024-01-04 02:41:48] frigate.video                  ERROR   : backyard_cam: ffmpeg process is not running. exiting capture thread...
2024-01-04 02:41:58.735745801  [2024-01-04 02:41:58] watchdog.backyard_cam          ERROR   : Ffmpeg process crashed unexpectedly for backyard_cam.
2024-01-04 02:41:58.735826921  [2024-01-04 02:41:58] watchdog.backyard_cam          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-01-04 02:41:58.735830081  [2024-01-04 02:41:58] ffmpeg.backyard_cam.detect     ERROR   : [tcp @ 0x563033049140] Connection to tcp://192.168.101.183:554?timeout=5000000 failed: Connection refused
2024-01-04 02:41:58.735832655  [2024-01-04 02:41:58] ffmpeg.backyard_cam.detect     ERROR   : rtsp://*:*@192.168.101.183/cam/realmonitor?channel=1&subtype=1: Connection refused
2024-01-04 02:41:58.756847098  [2024-01-04 02:41:58] ffmpeg.backyard_cam.record     ERROR   : [tcp @ 0x556158712180] Connection to tcp://192.168.101.183:554?timeout=5000000 failed: Connection refused
2024-01-04 02:41:58.756970528  [2024-01-04 02:41:58] ffmpeg.backyard_cam.record     ERROR   : rtsp://*:*@192.168.101.183/: Connection refused
2024-01-04 02:41:58.907798108  [2024-01-04 02:41:58] frigate.video                  ERROR   : backyard_cam: Unable to read frames from ffmpeg process.
2024-01-04 02:41:58.907959548  [2024-01-04 02:41:58] frigate.video                  ERROR   : backyard_cam: ffmpeg process is not running. exiting capture thread...
2024-01-04 02:42:08.777394328  [2024-01-04 02:42:08] watchdog.backyard_cam          ERROR   : Ffmpeg process crashed unexpectedly for backyard_cam.
2024-01-04 02:42:08.777526439  [2024-01-04 02:42:08] watchdog.backyard_cam          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-01-04 02:42:08.777534588  [2024-01-04 02:42:08] ffmpeg.backyard_cam.detect     ERROR   : [tcp @ 0x56074a026140] Connection to tcp://192.168.101.183:554?timeout=5000000 failed: Connection refused
2024-01-04 02:42:08.777541523  [2024-01-04 02:42:08] ffmpeg.backyard_cam.detect     ERROR   : rtsp://*:*@192.168.101.183/cam/realmonitor?channel=1&subtype=1: Connection refused
2024-01-04 02:42:08.819185772  [2024-01-04 02:42:08] ffmpeg.backyard_cam.record     ERROR   : [tcp @ 0x55c3deb9e180] Connection to tcp://192.168.101.183:554?timeout=5000000 failed: Connection refused
2024-01-04 02:42:08.819324604  [2024-01-04 02:42:08] ffmpeg.backyard_cam.record     ERROR   : rtsp://*:*@192.168.101.183/: Connection refused
2024-01-04 03:47:18.250927374  [2024-01-04 03:47:18] frigate.record                 ERROR   : Unable to convert /tmp/cache/side_cam-20240104034611.mp4 to /media/frigate/recordings/2024-01-04/11/side_cam/46.11.mp4
2024-01-04 03:47:18.250970372  [2024-01-04 03:47:18] frigate.record                 ERROR   : ffmpeg version n5.1-2-g915ef932a3-20220731 Copyright (c) 2000-2022 the FFmpeg developers
2024-01-04 03:47:18.250972949    built with gcc 12.1.0 (crosstool-NG 1.25.0.55_3defb7b)
2024-01-04 03:47:18.250983642    configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-ffbuild-linux-gnu- --arch=x86_64 --target-os=linux --enable-gpl --enable-version3 --disable-debug --enable-iconv --enable-libxml2 --enable-zlib --enable-libfreetype --enable-libfribidi --enable-gmp --enable-lzma --enable-fontconfig --enable-libvorbis --enable-opencl --enable-libpulse --enable-libvmaf --enable-libxcb --enable-xlib --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-libdav1d --enable-libdavs2 --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libass --enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-mbedtls --enable-librist --enable-libtheora --enable-libvpx --enable-libwebp --enable-lv2 --enable-libmfx --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --disable-schannel --enable-sdl2 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libdrm --enable-vaapi --enable-libvidstab --enable-vulkan --enable-libshaderc --enable-libplacebo --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-ldflags=-pthread --extra-ldexeflags=-pie --extra-libs='-ldl -lgomp' --extra-version=20220731
2024-01-04 03:47:18.250985324    libavutil      57. 28.100 / 57. 28.100
2024-01-04 03:47:18.250986769    libavcodec     59. 37.100 / 59. 37.100
2024-01-04 03:47:18.250988092    libavformat    59. 27.100 / 59. 27.100
2024-01-04 03:47:18.250989353    libavdevice    59.  7.100 / 59.  7.100
2024-01-04 03:47:18.250990620    libavfilter     8. 44.100 /  8. 44.100
2024-01-04 03:47:18.250991882    libswscale      6.  7.100 /  6.  7.100
2024-01-04 03:47:18.250993185    libswresample   4.  7.100 /  4.  7.100
2024-01-04 03:47:18.250994433    libpostproc    56.  6.100 / 56.  6.100
2024-01-04 03:47:18.250995550
cliffjao commented 10 months ago

Hey @NickM-27 - can you provide any assistance on this, or anything further you need from me? It's seg faulting on me about once a day, sometimes multiple times a day. Thanks.

NickM-27 commented 10 months ago

it's not clear to me what the issue is, we have only had one or two reports of seg faults and it ended up being a memory issue. You may want to run a mem test and see if the memory is failing.

are you running frigate in an HA addon?

github-actions[bot] commented 9 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.