search

blakeblackshear / frigate

NVR with realtime local object detection for IP cameras
https://frigate.video
MIT License
19.13k stars 1.75k forks source link

[Support]: Missing time in my recordings per camera even after upgrading to beta6 #8804

Closed superdong69 closed 10 months ago

superdong69 commented 11 months ago

Describe the problem you are having

Most of the hours of recording of my frigate server to a 6TB cctv drive on my NAS only contain 32mins. Some 11mins, and other the full 59:59. Seems to be completely random. Running 8 cameras, I have about a 2TB surplus on my system, so I know I'm not running out of hard drive space. A bunch of new stuff in the logs I've never seen before. This log is from the system reboot after beta6 upgrade to present. <Log edited for character limit, notations marked as indicated>

Version

frigate:0.13.0-beta6

Frigate config file

ui:
  use_experimental: false
  live_mode: mse
model:
  path: plus://<codehere>
mqtt:
  host: 192.168.1.80
  port: 1883
  topic_prefix: frigate
  client_id: frigate
  user: user
  password: pass
  stats_interval: 300
record:
  expire_interval: 10
go2rtc:
  streams:
    driveway:
      - rtsp://user:pass@192.168.1.95:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
    driveway_sub:
      - rtsp://user:pass@192.168.1.95:554/cam/realmonitor?channel=1&subtype=2&unicast=true&proto=Onvif
    garage_rear:
      - rtsp://user:pass@192.168.1.94:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
    garage_rear_sub:
      - rtsp://user:pass@192.168.1.94:554/cam/realmonitor?channel=1&subtype=2&unicast=true&proto=Onvif
    house_front:
      - rtsp://user:pass@192.168.1.93:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
    house_front_sub:
      - rtsp://user:pass@192.168.1.93:554/cam/realmonitor?channel=1&subtype=2&unicast=true&proto=Onvif
    house_side:
      - rtsp://user:pass@192.168.1.90:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
    house_side_sub:
      - rtsp://user:pass@192.168.1.90:554/cam/realmonitor?channel=1&subtype=2&unicast=true&proto=Onvif
    house_back1:
      - rtsp://user:pass@192.168.1.91:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
    house_back1_sub:
      - rtsp://user:pass@192.168.1.91:554/cam/realmonitor?channel=1&subtype=2&unicast=true&proto=Onvif
    garage_side:
      - rtsp://user:pass@192.168.1.92:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
    garage_side_sub:
      - rtsp://user:pass@192.168.1.92:554/cam/realmonitor?channel=1&subtype=2&unicast=true&proto=Onvif
  webrtc:
    candidates:
      - 192.168.1.79:8555
      - stun:8555
timestamp_style:
  position: tr
  format: "%m/%d/%Y %H:%M:%S"
  color:
    red: 255
    green: 255
    blue: 255
  thickness: 2
  effect: shadow
objects:
  track:
    - face
    - person
    - dog
    - car
    - ups
    - fedex
    - amazon
    - package
  filters:
    face:
      min_score: 0.7
      threshold: 0.9
    dog:
      min_score: 0.7
      threshold: 0.9
    person:
      min_score: 0.7
      threshold: 0.9
    car:
      min_score: 0.6
      threshold: 0.8
    ups:
      min_score: 0.7
      threshold: 0.9
    fedex:
      min_score: 0.7
      threshold: 0.9
    amazon:
      min_score: 0.7
      threshold: 0.9
cameras:
  driveway:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/driveway_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/driveway
          input_args: preset-rtsp-restream
          roles:
            - record
      output_args:
        record: preset-record-generic-audio-aac
    detect:
      width: 1920
      height: 1080
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      required_zones:
        - monitor_driveway
        - monitor_car_detect
      crop: true
      height: 500
      retain:
        default: 5
    zones:
      monitor_driveway:
        coordinates: 0,504,101,428,239,357,333,310,442,259,536,201,571,162,644,99,693,88,747,75,800,69,930,53,1046,59,1160,59,1305,61,1381,68,1409,68,1431,96,1513,99,1582,109,1649,119,1700,128,1760,138,1833,164,1920,200,1920,1080,0,1080
        objects:
          - face
          - car
          - fedex
          - ups
          - amazon
          - person
          - dog
        stationary:
          duration: 60
          filter:
            car: {}
      monitor_car_detect:
        coordinates: 1497,306,579,226,768,100,1018,93
        objects:
          - face
          - car
          - fedex
          - ups
          - amazon
          - person
          - dog
    motion:
      mask:
        - 1846,34,1851,84,1440,83,1440,40
        - 0,0,453,0,470,122,0,396
      threshold: 20
      contour_area: 15
    record:
      enabled: true
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 14
          mode: active_objects
        required_zones:
          - monitor_driveway
          - monitor_car_detect
        pre_capture: 5
        post_capture: 15
  house_front:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/house_front_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/house_front
          input_args: preset-rtsp-restream
          roles:
            - record
      output_args:
        record: preset-record-generic-audio-aac
    detect:
      width: 1920
      height: 1080
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      required_zones:
        - monitor_house_front
        - monitor_car_detect
      crop: true
      height: 500
      retain:
        default: 5
    zones:
      monitor_house_front:
        coordinates: 0,210,45,201,105,182,193,147,320,112,410,95,574,69,738,45,928,21,1038,21,1147,21,1242,40,1391,83,1559,141,1758,235,1920,333,1920,1080,0,1080
        objects:
          - face
          - car
          - fedex
          - ups
          - amazon
          - person
          - dog
        stationary:
          duration: 60
          filter:
            car: {}
      monitor_car_detect:
        coordinates: 1229,70,649,117,465,156,376,94,546,71,695,45,885,21,1013,21
        objects:
          - face
          - car
          - fedex
          - ups
          - amazon
          - person
          - dog
    motion:
      mask:
        - 1853,40,1858,86,1440,87,1442,39
      threshold: 20
      contour_area: 15
    record:
      enabled: true
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 14
          mode: active_objects
        required_zones:
          - monitor_house_front
          - monitor_car_detect
        pre_capture: 5
        post_capture: 15
  garage_rear:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/garage_rear_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/garage_rear
          input_args: preset-rtsp-restream
          roles:
            - record
      output_args:
        record: preset-record-generic-audio-aac
    detect:
      width: 1920
      height: 1080
      fps: 5
    objects:
      track:
        - face
        - person
        - dog
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      required_zones:
        - monitor_garage_rear
      crop: true
      height: 500
      retain:
        default: 5
    zones:
      monitor_garage_rear:
        coordinates:  0,1080,1691,1080,1756,908,1920,826,1920,403,1899,367,1872,334,1788,264,1680,228,1642,224,1198,159,1140,108,1101,57,1082,26,1019,21,843,0,565,0,405,25,214,83,0,175
        objects:
          - face
          - person
          - dog
    motion:
      mask:
        - 1716,923,1920,783,1920,1080,1619,1080
        - 1436,80,1845,83,1845,34,1439,38
        - 0,1080,122,1080,0,911
      threshold: 20
      contour_area: 15
    record:
      enabled: true
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 14
          mode: active_objects
        required_zones:
          - monitor_garage_rear
        pre_capture: 5
        post_capture: 15
  house_side:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/house_side_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/house_side
          input_args: preset-rtsp-restream
          roles:
            - record
      output_args:
        record: preset-record-generic-audio-aac
    detect:
      width: 1920
      height: 1080
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      required_zones:
        - monitor_house_side
        - monitor_house_side_dog
      crop: true
      height: 500
      retain:
        default: 5
    zones:
      monitor_house_side:
        coordinates: 269,886,377,808,317,671,222,550,165,470,96,504,64,415,29,297,40,258,124,210,175,190,246,162,404,117,473,97,569,75,642,61,706,49,787,38,873,31,945,25,1019,23,1087,24,1154,26,1216,29,1279,38,1347,49,1408,64,1485,90,1566,115,1631,138,1730,171,1920,226,1920,424,1920,1080,398,1080
        objects:
          - face
          - person
        stationary:
          duration: 60
          filter:
            car: {}
      monitor_house_side_dog:
        coordinates: 21,279,57,266,86,251,113,238,156,216,199,195,241,177,360,147,424,124,478,107,539,87,587,77,650,65,709,55,772,49,832,42,882,38,939,32,1005,24,1046,24,1094,23,1140,23,1195,24,1247,30,1359,46,1442,80,235,572,171,476,93,510
        objects:
          - face
          - dog
    motion:
      mask:
        - 1846,34,1851,84,1440,83,1440,40
        - 0,0,453,0,470,122,0,396
      threshold: 20
      contour_area: 15
    record:
      enabled: true
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 14
          mode: active_objects
        required_zones:
          - monitor_house_side_dog
          - monitor_house_side
        pre_capture: 5
        post_capture: 15
  house_back1:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/house_back1_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/house_back1
          input_args: preset-rtsp-restream
          roles:
            - record
      output_args:
        record: preset-record-generic-audio-aac
    detect:
      width: 1920
      height: 1080
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      required_zones:
        - monitor_house_back1
      crop: true
      height: 500
      retain:
        default: 5
    zones:
      monitor_house_back1:
        coordinates: 1613,1080,1920,725,1920,509,1830,454,1881,319,1817,279,1726,231,1637,200,1549,165,1455,128,1332,88,1263,65,1142,40,1055,27,963,21,890,21,807,21,715,21,637,25,539,36,467,33,355,64,196,80,0,127,0,1080
        objects:
          - face
          - person
    motion:
      mask:
        - 1846,34,1851,84,1440,83,1440,40
        - 0,0,453,0,470,122,0,396
      threshold: 20
      contour_area: 15
    record:
      enabled: true
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 14
          mode: active_objects
        required_zones:
          - monitor_house_back1
        pre_capture: 5
        post_capture: 15
  front_doorbell:
    ffmpeg:
      inputs:
        - path: rtsp://192.168.1.80:8557/front-doorbell
          input_args: preset-rtsp-restream
          roles:
            - detect
            - record
      output_args:
        record: preset-record-generic-audio-aac
    detect:
      width: 1296
      height: 1728
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      required_zones:
        - monitor_front_doorbell
        - monitor_doorstep
      crop: true
      height: 500
      retain:
        default: 5
    zones:
      monitor_front_doorbell:
        coordinates: 0,1529,356,1417,469,1491,903,1623,1296,1670,1296,1347,1296,1074,1212,1065,1114,1059,1008,1049,886,1044,840,1043,772,1042,695,1039,542,1038,350,1041,0,1038
        objects:
          - face
          - fedex
          - ups
          - amazon
          - person
          - dog
        stationary:
          duration: 60
          filter:
            car: {}
      monitor_doorstep:
        coordinates: 0,1728,875,1728,941,1643,647,1560,406,1471,356,1480,292,1456,222,1492,57,1534,0,1549
        objects:
          - face
          - fedex
          - ups
          - amazon
          - person
          - dog
          - package
    motion:
      mask:
        - 1296,1728,1296,1674,922,1682,927,1728
      threshold: 20
      contour_area: 15
    record:
      enabled: true
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 14
          mode: active_objects
        required_zones:
          - monitor_doorstep
          - monitor_front_doorbell
        pre_capture: 5
        post_capture: 15
  back_doorbell:
    ffmpeg:
      inputs:
        - path: rtsp://192.168.1.80:8557/back_doorbell
          input_args: preset-rtsp-restream
          roles:
            - detect
            - record
      output_args:
        record: preset-record-generic-audio-aac
    detect:
      width: 1296
      height: 1728
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      required_zones:
        - monitor_back_doorbell
        - monitor_back_doorstep
      crop: true
      height: 500
      retain:
        default: 5
    zones:
      monitor_back_doorbell:
        coordinates: 66,1035,0,1036,0,1728,362,1728,318,1568,296,1485,334,1472,528,1438,915,1355,926,1006,837,1003,770,1009,651,1005,581,1010,475,1014,227,1027
        objects:
          - face
          - person
          - dog
        stationary:
          duration: 60
          filter:
            car: {}
      monitor_back_doorstep:
        coordinates: 358,1728,1296,1728,1296,1548,1006,1463,957,1490,923,1474,872,1494,852,1473,764,1397,295,1486
        objects:
          - face
          - person
          - dog
    motion:
      mask:
        - 1296,1728,1296,1674,922,1682,927,1728
      threshold: 20
      contour_area: 15
    record:
      enabled: true
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 14
          mode: active_objects
        required_zones:
          - monitor_back_doorstep
          - monitor_back_doorbell
        pre_capture: 5
        post_capture: 15
  garage_side:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/garage_side_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/garage_side
          input_args: preset-rtsp-restream
          roles:
            - record
      output_args:
        record: preset-record-generic-audio-aac
    detect:
      width: 1920
      height: 1080
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      required_zones:
        - monitor_garage_side
      crop: true
      height: 500
      retain:
        default: 5
    zones:
      monitor_garage_side:
        coordinates: 1920,1080,1920,177,1733,97,1493,21,1028,0,705,23,501,32,361,95,87,151,0,195,0,1080
        objects:
          - face
          - person
          - dog
        stationary:
          duration: 60
          filter:
            car: {}
    motion:
      mask:
        - 1844,43,1843,94,1450,87,1446,45
      threshold: 20
      contour_area: 15
    record:
      enabled: true
      retain:
        days: 7
        mode: motion
      events:
        retain:
          default: 14
          mode: active_objects
        required_zones:
          - monitor_garage_side
        pre_capture: 5
        post_capture: 15

detectors:
  coral:
    type: edgetpu
    device: usb
rtmp:
  enabled: false
birdseye:
  enabled: true
  restream: false
  width: 1280
  height: 720
  quality: 1
  mode: continuous
live:
  height: 640
  quality: 1

Relevant log output

2023-11-27 19:15:45.509745008  [INFO] Preparing Frigate...
2023-11-27 19:15:45.523967585  [INFO] Starting Frigate...
2023-11-27 19:15:46.688630887  [2023-11-27 19:15:46] frigate.app                    INFO    : Starting Frigate (0.13.0-614a36a)
2023-11-27 19:15:49.437509021  [2023-11-27 19:15:49] peewee_migrate.logs            INFO    : Starting migrations
2023-11-27 19:15:49.461553461  [2023-11-27 19:15:49] peewee_migrate.logs            INFO    : Migrate "020_update_index_recordings"
2023-11-27 19:15:49.461665918  [2023-11-27 19:15:49] peewee_migrate.logs            INFO    : sql ('DROP INDEX recordings_end_time_start_time',)
2023-11-27 19:15:49.491594816  [2023-11-27 19:15:49] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "recordings_camera_start_time_end_time" ON "recordings" ("camera", "start_time" DESC, "end_time" DESC)',)
2023-11-27 19:15:49.637065834  [2023-11-27 19:15:49] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "recordings_api_recordings_summary" ON "recordings" ("camera", "start_time" DESC, "duration", "motion", "objects")',)
2023-11-27 19:15:49.801851798  [2023-11-27 19:15:49] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "recordings_start_time" ON "recordings" ("start_time")',)
2023-11-27 19:15:49.863089055  [2023-11-27 19:15:49] peewee_migrate.logs            INFO    : Done 020_update_index_recordings
2023-11-27 19:15:59.897046156  [2023-11-27 19:15:59] frigate.app                    INFO    : Recording process started: 443
2023-11-27 19:15:59.899094150  [2023-11-27 19:15:59] frigate.app                    INFO    : go2rtc process pid: 89
2023-11-27 19:15:59.917222515  [2023-11-27 19:15:59] detector.coral                 INFO    : Starting detection process: 452
2023-11-27 19:16:02.567092517  [2023-11-27 19:15:59] frigate.app                    INFO    : Output process started: 454
2023-11-27 19:16:02.567910162  [2023-11-27 19:16:00] frigate.app                    INFO    : Camera processor started for driveway: 470
2023-11-27 19:16:02.568359153  [2023-11-27 19:16:00] frigate.app                    INFO    : Camera processor started for house_front: 472
2023-11-27 19:16:02.568566006  [2023-11-27 19:16:00] frigate.app                    INFO    : Camera processor started for garage_rear: 478
2023-11-27 19:16:02.577854958  [2023-11-27 19:15:59] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2023-11-27 19:16:02.578888820  [2023-11-27 19:16:02] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2023-11-27 19:16:02.579368137  [2023-11-27 19:16:00] frigate.app                    INFO    : Camera processor started for house_side: 494
2023-11-27 19:16:02.579842865  [2023-11-27 19:16:00] frigate.app                    INFO    : Camera processor started for house_back1: 496
2023-11-27 19:16:02.580042856  [2023-11-27 19:16:00] frigate.app                    INFO    : Camera processor started for front_doorbell: 499
2023-11-27 19:16:02.580148342  [2023-11-27 19:16:00] frigate.app                    INFO    : Camera processor started for back_doorbell: 501
2023-11-27 19:16:02.580172217  [2023-11-27 19:16:00] frigate.app                    INFO    : Camera processor started for garage_side: 503
2023-11-27 19:16:02.580211724  [2023-11-27 19:16:00] frigate.app                    INFO    : Capture process started for driveway: 505
2023-11-27 19:16:02.580251256  [2023-11-27 19:16:00] frigate.app                    INFO    : Capture process started for house_front: 509
2023-11-27 19:16:02.580290216  [2023-11-27 19:16:00] frigate.app                    INFO    : Capture process started for garage_rear: 512
2023-11-27 19:16:02.580328378  [2023-11-27 19:16:00] frigate.app                    INFO    : Capture process started for house_side: 516
2023-11-27 19:16:02.580366509  [2023-11-27 19:16:00] frigate.app                    INFO    : Capture process started for house_back1: 520
2023-11-27 19:16:02.580403619  [2023-11-27 19:16:00] frigate.app                    INFO    : Capture process started for front_doorbell: 530
2023-11-27 19:16:02.580441316  [2023-11-27 19:16:00] frigate.app                    INFO    : Capture process started for back_doorbell: 536
2023-11-27 19:16:02.580479212  [2023-11-27 19:16:00] frigate.app                    INFO    : Capture process started for garage_side: 545
2023-11-27 22:48:48.713792787  [2023-11-27 22:48:48] frigate.video                  ERROR   : house_back1: Unable to read frames from ffmpeg process.
2023-11-27 22:48:48.713869225  [2023-11-27 22:48:48] frigate.video                  ERROR   : house_back1: ffmpeg process is not running. exiting capture thread...
2023-11-27 22:48:50.814956062  [2023-11-27 22:48:50] watchdog.house_back1           ERROR   : Ffmpeg process crashed unexpectedly for house_back1.
2023-11-27 22:48:50.815138705  [2023-11-27 22:48:50] watchdog.house_back1           ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-27 22:48:50.815281954  [2023-11-27 22:48:50] ffmpeg.house_back1.detect      ERROR   : rtsp://127.0.0.1:8554/house_back1_sub: Connection timed out
2023-11-27 22:48:50.815401661  [2023-11-27 22:48:50] ffmpeg.house_back1.detect      ERROR   :     Last message repeated 1 times
2023-11-27 22:48:50.826789616  [2023-11-27 22:48:50] ffmpeg.house_back1.record      ERROR   : [aac @ 0x55fb4f3041c0] Too many bits 8832.000000 > 6144 per frame requested, clamping to max
2023-11-27 22:48:50.833787471  [2023-11-27 22:48:50] ffmpeg.house_back1.record      ERROR   : [segment @ 0x55fb4f300600] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2023-11-27 22:48:50.833885096  [2023-11-27 22:48:50] ffmpeg.house_back1.record      ERROR   : rtsp://127.0.0.1:8554/house_back1: Connection timed out
2023-11-27 22:48:50.833970074  [2023-11-27 22:48:50] watchdog.house_back1           INFO    : Terminating the existing ffmpeg process...
2023-11-27 22:48:50.834039801  [2023-11-27 22:48:50] watchdog.house_back1           INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-27 22:48:55.937179774  [2023-11-27 22:48:55] frigate.video                  ERROR   : house_back1: Unable to read frames from ffmpeg process.
2023-11-27 22:48:55.937337327  [2023-11-27 22:48:55] frigate.video                  ERROR   : house_back1: ffmpeg process is not running. exiting capture thread...
2023-11-27 22:49:00.838944611  [2023-11-27 22:49:00] watchdog.house_back1           ERROR   : Ffmpeg process crashed unexpectedly for house_back1.
2023-11-27 22:49:00.839031616  [2023-11-27 22:49:00] watchdog.house_back1           ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-27 22:49:00.839101659  [2023-11-27 22:49:00] ffmpeg.house_back1.detect      ERROR   : rtsp://127.0.0.1:8554/house_back1_sub: Invalid data found when processing input
2023-11-27 22:49:00.848163686  [2023-11-27 22:49:00] ffmpeg.house_back1.record      ERROR   : rtsp://127.0.0.1:8554/house_back1: Invalid data found when processing input
2023-11-27 22:49:00.848308129  [2023-11-27 22:49:00] watchdog.house_back1           INFO    : Terminating the existing ffmpeg process...
2023-11-27 22:49:00.848369959  [2023-11-27 22:49:00] watchdog.house_back1           INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-27 22:49:03.928286096  [2023-11-27 22:49:03] frigate.video                  ERROR   : house_back1: Unable to read frames from ffmpeg process.
2023-11-27 22:49:03.928395631  [2023-11-27 22:49:03] frigate.video                  ERROR   : house_back1: ffmpeg process is not running. exiting capture thread...
2023-11-27 22:49:10.857971110  [2023-11-27 22:49:10] watchdog.house_back1           ERROR   : Ffmpeg process crashed unexpectedly for house_back1.
2023-11-27 22:49:10.858326087  [2023-11-27 22:49:10] watchdog.house_back1           ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-27 22:49:10.858705435  [2023-11-27 22:49:10] ffmpeg.house_back1.detect      ERROR   : [rtsp @ 0x555773cc8c40] method DESCRIBE failed: 404 Not Found
2023-11-27 22:49:10.859024498  [2023-11-27 22:49:10] ffmpeg.house_back1.detect      ERROR   : rtsp://127.0.0.1:8554/house_back1_sub: Server returned 404 Not Found
2023-11-27 22:49:10.903125710  [2023-11-27 22:49:10] ffmpeg.house_back1.record      ERROR   : [rtsp @ 0x55faab0f7d80] method DESCRIBE failed: 404 Not Found
2023-11-27 22:49:10.903409632  [2023-11-27 22:49:10] ffmpeg.house_back1.record      ERROR   : rtsp://127.0.0.1:8554/house_back1: Server returned 404 Not Found
2023-11-27 22:49:10.903646736  [2023-11-27 22:49:10] watchdog.house_back1           INFO    : Terminating the existing ffmpeg process...
2023-11-27 22:49:10.903862196  [2023-11-27 22:49:10] watchdog.house_back1           INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-27 22:49:14.269960595  [2023-11-27 22:49:14] frigate.video                  ERROR   : house_back1: Unable to read frames from ffmpeg process.
2023-11-27 22:49:14.270070358  [2023-11-27 22:49:14] frigate.video                  ERROR   : house_back1: ffmpeg process is not running. exiting capture thread...
2023-11-27 22:49:20.914795667  [2023-11-27 22:49:20] watchdog.house_back1           ERROR   : Ffmpeg process crashed unexpectedly for house_back1.
2023-11-27 22:49:20.914900070  [2023-11-27 22:49:20] watchdog.house_back1           ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-27 22:49:20.914966798  [2023-11-27 22:49:20] ffmpeg.house_back1.detect      ERROR   : [rtsp @ 0x55c0eab90c40] method DESCRIBE failed: 404 Not Found
2023-11-27 22:49:20.915027892  [2023-11-27 22:49:20] ffmpeg.house_back1.detect      ERROR   : rtsp://127.0.0.1:8554/house_back1_sub: Server returned 404 Not Found
2023-11-27 22:49:20.927666889  [2023-11-27 22:49:20] ffmpeg.house_back1.record      ERROR   : [rtsp @ 0x5583f5abed80] method DESCRIBE failed: 404 Not Found
2023-11-27 22:49:20.927781167  [2023-11-27 22:49:20] ffmpeg.house_back1.record      ERROR   : rtsp://127.0.0.1:8554/house_back1: Server returned 404 Not Found
2023-11-27 22:49:20.927851059  [2023-11-27 22:49:20] watchdog.house_back1           INFO    : Terminating the existing ffmpeg process...
2023-11-27 22:49:20.927910579  [2023-11-27 22:49:20] watchdog.house_back1           INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-27 22:49:20.932906565  [2023-11-27 22:49:20] frigate.video                  ERROR   : house_back1: Unable to read frames from ffmpeg process.
2023-11-27 22:49:20.933026065  [2023-11-27 22:49:20] frigate.video                  ERROR   : house_back1: ffmpeg process is not running. exiting capture thread...
2023-11-27 22:49:30.937586085  [2023-11-27 22:49:30] watchdog.house_back1           ERROR   : Ffmpeg process crashed unexpectedly for house_back1.
2023-11-27 22:49:30.937670023  [2023-11-27 22:49:30] watchdog.house_back1           ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-27 22:49:30.937741999  [2023-11-27 22:49:30] ffmpeg.house_back1.detect      ERROR   : [rtsp @ 0x563626122c40] method DESCRIBE failed: 404 Not Found
2023-11-27 22:49:30.937802193  [2023-11-27 22:49:30] ffmpeg.house_back1.detect      ERROR   : rtsp://127.0.0.1:8554/house_back1_sub: Server returned 404 Not Found
2023-11-27 22:49:30.948995029  [2023-11-27 22:49:30] ffmpeg.house_back1.record      ERROR   : [rtsp @ 0x562789f03d80] method DESCRIBE failed: 404 Not Found
2023-11-27 22:49:30.949106667  [2023-11-27 22:49:30] ffmpeg.house_back1.record      ERROR   : rtsp://127.0.0.1:8554/house_back1: Server returned 404 Not Found
2023-11-27 22:49:30.949179005  [2023-11-27 22:49:30] watchdog.house_back1           INFO    : Terminating the existing ffmpeg process...
2023-11-27 22:49:30.949249995  [2023-11-27 22:49:30] watchdog.house_back1           INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-28 16:08:21.777718151  [2023-11-28 16:08:21] watchdog.front_doorbell        INFO    : front_doorbell exceeded fps limit. Exiting ffmpeg...
2023-11-28 16:08:21.777779465  [2023-11-28 16:08:21] watchdog.front_doorbell        INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-28 16:08:21.814074433  [2023-11-28 16:08:21] frigate.video                  ERROR   : front_doorbell: Unable to read frames from ffmpeg process.
2023-11-28 16:08:21.814391285  [2023-11-28 16:08:21] frigate.video                  ERROR   : front_doorbell: ffmpeg process is not running. exiting capture thread...
2023-11-28 16:08:31.818474674  [2023-11-28 16:08:31] watchdog.front_doorbell        ERROR   : Ffmpeg process crashed unexpectedly for front_doorbell.
2023-11-28 16:08:31.818566912  [2023-11-28 16:08:31] watchdog.front_doorbell        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-28 16:08:31.818654614  [2023-11-28 16:08:31] ffmpeg.front_doorbell.detect   ERROR   : [segment @ 0x55ed7ca61bc0] Non-monotonous DTS in output stream 0:1; previous: 3570429612, current: 3570427648; changing to 3570429613. This may result in incorrect timestamps in the output file.
2023-11-28 16:08:31.818724041  [2023-11-28 16:08:31] ffmpeg.front_doorbell.detect   ERROR   : [segment @ 0x55ed7ca61bc0] Non-monotonous DTS in output stream 0:1; previous: 3570429613, current: 3570428672; changing to 3570429614. This may result in incorrect timestamps in the output file.
2023-11-28 16:08:31.818930680  [2023-11-28 16:08:31] ffmpeg.front_doorbell.detect   ERROR   : [segment @ 0x55ed7ca61bc0] Non-monotonous DTS in output stream 0:0; previous: 761896172, current: 761895843; changing to 761896173. This may result in incorrect timestamps in the output file.
2023-11-28 16:08:31.819012671  [2023-11-28 16:08:31] ffmpeg.front_doorbell.detect   ERROR   : [segment @ 0x55ed7ca61bc0] Non-monotonous DTS in output stream 0:0; previous: 762101433, current: 762101420; changing to 762101434. This may result in incorrect timestamps in the output file.
2023-11-28 16:08:31.819265907  [2023-11-28 16:08:31] ffmpeg.front_doorbell.detect   ERROR   : [aac @ 0x55ed7ca62940] Queue input is backward in time
<Above 5 lines reoccur another 30 times in actual log>
2023-11-28 16:08:51.830848522  [2023-11-28 16:08:51] watchdog.front_doorbell        INFO    : No frames received from front_doorbell in 20 seconds. Exiting ffmpeg...
2023-11-28 16:08:51.830962464  [2023-11-28 16:08:51] watchdog.front_doorbell        INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-28 16:08:52.441844100  [2023-11-28 16:08:52] frigate.video                  ERROR   : front_doorbell: Unable to read frames from ffmpeg process.
2023-11-28 16:08:52.442094566  [2023-11-28 16:08:52] frigate.video                  ERROR   : front_doorbell: ffmpeg process is not running. exiting capture thread...
2023-11-28 16:09:02.443583583  [2023-11-28 16:09:02] watchdog.front_doorbell        ERROR   : Ffmpeg process crashed unexpectedly for front_doorbell.
2023-11-28 16:09:02.443721940  [2023-11-28 16:09:02] watchdog.front_doorbell        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-28 16:09:02.443821947  [2023-11-28 16:09:02] ffmpeg.front_doorbell.detect   ERROR   : [segment @ 0x5575fa51d6c0] Packets poorly interleaved, failed to avoid negative timestamp -236432 in stream 0.
2023-11-28 16:09:02.443915382  [2023-11-28 16:09:02] ffmpeg.front_doorbell.detect   ERROR   : Try -max_interleave_delta 0 as a possible workaround.
2023-11-28 16:09:02.444004043  [2023-11-28 16:09:02] ffmpeg.front_doorbell.detect   ERROR   : [segment @ 0x5575fa51d6c0] Packets poorly interleaved, failed to avoid negative timestamp -235920 in stream 0.
2023-11-28 16:09:02.444088500  [2023-11-28 16:09:02] ffmpeg.front_doorbell.detect   ERROR   : Try -max_interleave_delta 0 as a possible workaround.
2023-11-28 16:09:02.444177970  [2023-11-28 16:09:02] ffmpeg.front_doorbell.detect   ERROR   : [segment @ 0x5575fa51d6c0] Packets poorly interleaved, failed to avoid negative timestamp -235408 in stream 0.
2023-11-28 16:09:02.444262861  [2023-11-28 16:09:02] ffmpeg.front_doorbell.detect   ERROR   : Try -max_interleave_delta 0 as a possible workaround.
2023-11-28 16:10:22.458176339  [2023-11-28 16:10:22] watchdog.front_doorbell        INFO    : front_doorbell exceeded fps limit. Exiting ffmpeg...
2023-11-28 16:10:22.458638242  [2023-11-28 16:10:22] watchdog.front_doorbell        INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-28 16:10:22.500891096  [2023-11-28 16:10:22] frigate.video                  ERROR   : front_doorbell: Unable to read frames from ffmpeg process.
2023-11-28 16:10:22.501154578  [2023-11-28 16:10:22] frigate.video                  ERROR   : front_doorbell: ffmpeg process is not running. exiting capture thread...
2023-11-28 16:10:32.503856318  [2023-11-28 16:10:32] watchdog.front_doorbell        ERROR   : Ffmpeg process crashed unexpectedly for front_doorbell.
2023-11-28 16:10:32.504236602  [2023-11-28 16:10:32] watchdog.front_doorbell        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-29 21:30:33.126442494  [2023-11-29 21:30:33] frigate.video                  ERROR   : driveway: Unable to read frames from ffmpeg process.
2023-11-29 21:30:33.126696057  [2023-11-29 21:30:33] frigate.video                  ERROR   : driveway: ffmpeg process is not running. exiting capture thread...
2023-11-29 21:30:37.727545951  [2023-11-29 21:30:37] watchdog.driveway              ERROR   : Ffmpeg process crashed unexpectedly for driveway.
2023-11-29 21:30:37.727714460  [2023-11-29 21:30:37] watchdog.driveway              ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-29 21:30:37.727883973  [2023-11-29 21:30:37] ffmpeg.driveway.detect         ERROR   : rtsp://127.0.0.1:8554/driveway_sub: Connection timed out
2023-11-29 21:30:37.727893361  [2023-11-29 21:30:37] ffmpeg.driveway.detect         ERROR   :     Last message repeated 1 times
2023-11-29 21:30:37.747473761  [2023-11-29 21:30:37] ffmpeg.driveway.record         ERROR   : [segment @ 0x55e9219a8a40] Non-monotonous DTS in output stream 0:0; previous: 1746585702, current: 1746585702; changing to 1746585703. This may result in incorrect timestamps in the output file.
<Reoccurs 200 times in log>
2023-11-29 21:30:37.752286428  [2023-11-29 21:30:37] ffmpeg.driveway.record         ERROR   : [aac @ 0x55e9219a2a80] Queue input is backward in time
2023-11-29 21:30:37.752334704  [2023-11-29 21:30:37] ffmpeg.driveway.record         ERROR   : [segment @ 0x55e9219a8a40] Non-monotonous DTS in output stream 0:1; previous: 1447410624, current: 1447410608; changing to 1447410625. This may result in incorrect timestamps in the output file.
2023-11-29 21:30:37.752381685  [2023-11-29 21:30:37] ffmpeg.driveway.record         ERROR   : rtsp://127.0.0.1:8554/driveway: Connection timed out
2023-11-29 21:30:37.752430743  [2023-11-29 21:30:37] watchdog.driveway              INFO    : Terminating the existing ffmpeg process...
2023-11-29 21:30:37.752479719  [2023-11-29 21:30:37] watchdog.driveway              INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-29 21:30:42.848439781  [2023-11-29 21:30:42] frigate.video                  ERROR   : driveway: Unable to read frames from ffmpeg process.
2023-11-29 21:30:42.848648209  [2023-11-29 21:30:42] frigate.video                  ERROR   : driveway: ffmpeg process is not running. exiting capture thread...
2023-11-29 21:30:47.764957706  [2023-11-29 21:30:47] watchdog.driveway              ERROR   : Ffmpeg process crashed unexpectedly for driveway.
2023-11-29 21:30:47.765123142  [2023-11-29 21:30:47] watchdog.driveway              ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-29 21:30:47.765160157  [2023-11-29 21:30:47] ffmpeg.driveway.detect         ERROR   : rtsp://127.0.0.1:8554/driveway_sub: Invalid data found when processing input
2023-11-29 21:30:47.778968320  [2023-11-29 21:30:47] ffmpeg.driveway.record         ERROR   : rtsp://127.0.0.1:8554/driveway: Invalid data found when processing input
2023-11-29 21:30:47.779421596  [2023-11-29 21:30:47] watchdog.driveway              INFO    : Terminating the existing ffmpeg process...
2023-11-29 21:30:47.779702061  [2023-11-29 21:30:47] watchdog.driveway              INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-29 21:30:50.784920975  [2023-11-29 21:30:50] frigate.video                  ERROR   : driveway: Unable to read frames from ffmpeg process.
2023-11-29 21:30:50.785512400  [2023-11-29 21:30:50] frigate.video                  ERROR   : driveway: ffmpeg process is not running. exiting capture thread...
2023-11-29 21:30:57.789060386  [2023-11-29 21:30:57] watchdog.driveway              ERROR   : Ffmpeg process crashed unexpectedly for driveway.
2023-11-29 21:30:57.789175159  [2023-11-29 21:30:57] watchdog.driveway              ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-29 21:30:57.789268121  [2023-11-29 21:30:57] ffmpeg.driveway.detect         ERROR   : [rtsp @ 0x55872767ac40] method DESCRIBE failed: 404 Not Found
2023-11-29 21:30:57.789352542  [2023-11-29 21:30:57] ffmpeg.driveway.detect         ERROR   : rtsp://127.0.0.1:8554/driveway_sub: Server returned 404 Not Found
2023-11-29 21:30:57.798673862  [2023-11-29 21:30:57] ffmpeg.driveway.record         ERROR   : [rtsp @ 0x55c5b1c43d80] method DESCRIBE failed: 404 Not Found
2023-11-29 21:30:57.798788824  [2023-11-29 21:30:57] ffmpeg.driveway.record         ERROR   : rtsp://127.0.0.1:8554/driveway: Server returned 404 Not Found
2023-11-29 21:30:57.798891829  [2023-11-29 21:30:57] watchdog.driveway              INFO    : Terminating the existing ffmpeg process...
2023-11-29 21:30:57.798981999  [2023-11-29 21:30:57] watchdog.driveway              INFO    : Waiting for ffmpeg to exit gracefully...
2023-11-29 21:30:57.812046122  [2023-11-29 21:30:57] frigate.video                  ERROR   : driveway: Unable to read frames from ffmpeg process.
2023-11-29 21:30:57.812664205  [2023-11-29 21:30:57] frigate.video                  ERROR   : driveway: ffmpeg process is not running. exiting capture thread...
2023-11-29 21:31:07.808630818  [2023-11-29 21:31:07] watchdog.driveway              ERROR   : Ffmpeg process crashed unexpectedly for driveway.
2023-11-29 21:31:07.808763506  [2023-11-29 21:31:07] watchdog.driveway              ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-11-29 21:31:07.808875209  [2023-11-29 21:31:07] ffmpeg.driveway.detect         ERROR   : [rtsp @ 0x5556dfb57c40] method DESCRIBE failed: 404 Not Found
2023-11-29 21:31:07.808933108  [2023-11-29 21:31:07] ffmpeg.driveway.detect         ERROR   : rtsp://127.0.0.1:8554/driveway_sub: Server returned 404 Not Found
2023-11-29 21:31:07.820091239  [2023-11-29 21:31:07] watchdog.driveway              ERROR   : No new recording segments were created for driveway in the last 120s. restarting the ffmpeg record process...
2023-11-29 21:31:07.820222905  [2023-11-29 21:31:07] watchdog.driveway              INFO    : Terminating the existing ffmpeg process...
2023-11-29 21:31:07.820321971  [2023-11-29 21:31:07] watchdog.driveway              INFO    : Waiting for ffmpeg to exit gracefully...

FFprobe output from your camera

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"20/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1728,"width":1296},{"avg_frame_rate":"0/0","codec_long_name":"Opus(OpusInteractiveAudioCodec)"}]}}]

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"5/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1080,"width":1920},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"5/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":2160,"width":3840},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"20/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1728,"width":1296},{"avg_frame_rate":"0/0","codec_long_name":"Opus(OpusInteractiveAudioCodec)"}]}}]

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"5/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1080,"width":1920},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"5/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":2160,"width":3840},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"4/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1080,"width":1920},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"4/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":2160,"width":3840},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"4/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1080,"width":1920},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"4/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":2160,"width":3840},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"4/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1080,"width":1920},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"30/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":2160,"width":3840},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"5/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1080,"width":1920},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"30/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":2160,"width":3840},{"avg_frame_rate":"0/0","codec_long_name":"AAC(AdvancedAudioCoding)"}]}}]

Frigate stats

{"cameras":{"back_doorbell":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.2,"capture_pid":536,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":547,"pid":501,"process_fps":5.2,"skipped_fps":0.0},"driveway":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.0,"capture_pid":505,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":1474208,"pid":470,"process_fps":5.0,"skipped_fps":0.0},"front_doorbell":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.0,"capture_pid":530,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":626114,"pid":499,"process_fps":5.0,"skipped_fps":0.0},"garage_rear":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.1,"capture_pid":512,"detection_enabled":1,"detection_fps":4.4,"ffmpeg_pid":517,"pid":478,"process_fps":5.1,"skipped_fps":0.0},"garage_side":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.1,"capture_pid":545,"detection_enabled":1,"detection_fps":0.6,"ffmpeg_pid":552,"pid":503,"process_fps":5.1,"skipped_fps":0.0},"house_back1":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.1,"capture_pid":520,"detection_enabled":1,"detection_fps":0.4,"ffmpeg_pid":87868,"pid":496,"process_fps":5.1,"skipped_fps":0.0},"house_front":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.0,"capture_pid":509,"detection_enabled":1,"detection_fps":0.0,"ffmpeg_pid":515,"pid":472,"process_fps":5.0,"skipped_fps":0.0},"house_side":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.0,"capture_pid":516,"detection_enabled":1,"detection_fps":7.8,"ffmpeg_pid":526,"pid":494,"process_fps":5.0,"skipped_fps":0.0}},"cpu_usages":{"1":{"cmdline":"/package/admin/s6/command/s6-svscan -d4 -- /run/service","cpu":"0.0","cpu_average":"0","mem":"0.0"},"15":{"cmdline":"s6-supervise s6-linux-init-shutdownd","cpu":"0.0","cpu_average":"0","mem":"0.0"},"17":{"cmdline":"/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B","cpu":"0.0","cpu_average":"0","mem":"0.0"},"24":{"cmdline":"s6-supervise go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"25":{"cmdline":"s6-supervise go2rtc-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"26":{"cmdline":"s6-supervise s6rc-fdholder","cpu":"0.0","cpu_average":"0","mem":"0.0"},"27":{"cmdline":"s6-supervise nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"28":{"cmdline":"s6-supervise nginx-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"29":{"cmdline":"s6-supervise s6rc-oneshot-runner","cpu":"0.0","cpu_average":"0","mem":"0.0"},"30":{"cmdline":"s6-supervise go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"31":{"cmdline":"s6-supervise frigate-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"32":{"cmdline":"s6-supervise frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"41":{"cmdline":"/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules","cpu":"0.0","cpu_average":"0","mem":"0.0"},"42":{"cmdline":"/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --","cpu":"0.0","cpu_average":"0","mem":"0.0"},"80":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"81":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"82":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"89":{"cmdline":"/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml","cpu":"22.4","cpu_average":"16","mem":"0.6"},"97":{"cmdline":"bash ./run.user go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"98":{"cmdline":"python3 -u -m frigate","cpu":"3.2","cpu_average":"3","mem":"4.9"},"113":{"cmdline":"nginx: master process nginx","cpu":"0.0","cpu_average":"0","mem":"0.1"},"145":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.2"},"146":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.2"},"147":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.2"},"148":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.2"},"159":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.2"},"185":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.2"},"224":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.2"},"256":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.2"},"287":{"cmdline":"nginx: cache manager process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"440":{"cmdline":"frigate.logger       ","cpu":"0.0","cpu_average":"0","mem":"0.5"},"443":{"cmdline":"frigate.recording_manager","cpu":"0.0","cpu_average":"8","mem":"1.2"},"451":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(69)","cpu":"0.6","cpu_average":"0","mem":"0.1"},"452":{"cmdline":"frigate.detector.coral","cpu":"1.4","cpu_average":"3","mem":"0.8"},"454":{"cmdline":"frigate.output       ","cpu":"3.2","cpu_average":"2","mem":"0.7"},"460":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1137x640 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"461":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1137x640 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"463":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1137x640 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"464":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1137x640 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"465":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1137x640 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"466":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1296x1728 -i pipe: -f mpegts -s 480x640 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"467":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1296x1728 -i pipe: -f mpegts -s 480x640 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"468":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1920x1080 -i pipe: -f mpegts -s 1137x640 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"470":{"cmdline":"frigate.process:driveway","cpu":"1.1","cpu_average":"3","mem":"1.1"},"471":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.3"},"472":{"cmdline":"frigate.process:house_front","cpu":"1.1","cpu_average":"2","mem":"1.1"},"478":{"cmdline":"frigate.process:garage_rear","cpu":"3.2","cpu_average":"3","mem":"1.1"},"494":{"cmdline":"frigate.process:house_side","cpu":"6.6","cpu_average":"6","mem":"1.1"},"496":{"cmdline":"frigate.process:house_back1","cpu":"1.4","cpu_average":"2","mem":"1.1"},"499":{"cmdline":"frigate.process:front_doorbell","cpu":"1.4","cpu_average":"2","mem":"1.1"},"501":{"cmdline":"frigate.process:back_doorbell","cpu":"1.1","cpu_average":"7","mem":"1.1"},"503":{"cmdline":"frigate.process:garage_side","cpu":"1.4","cpu_average":"3","mem":"1.1"},"505":{"cmdline":"frigate.capture:driveway","cpu":"2.0","cpu_average":"2","mem":"0.8"},"509":{"cmdline":"frigate.capture:house_front","cpu":"2.3","cpu_average":"2","mem":"0.7"},"512":{"cmdline":"frigate.capture:garage_rear","cpu":"2.9","cpu_average":"2","mem":"0.7"},"515":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/house_front_sub -r 5 -vf fps=5,scale=1920:1080 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"24.7","cpu_average":"12","mem":"0.5"},"516":{"cmdline":"frigate.capture:house_side","cpu":"2.9","cpu_average":"2","mem":"0.7"},"517":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/garage_rear_sub -r 5 -vf fps=5,scale=1920:1080 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"18.1","cpu_average":"10","mem":"0.5"},"520":{"cmdline":"frigate.capture:house_back1","cpu":"2.6","cpu_average":"2","mem":"0.8"},"526":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/house_side_sub -r 5 -vf fps=5,scale=1920:1080 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"23.8","cpu_average":"11","mem":"0.5"},"529":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/house_front -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/house_front@%Y%m%d%H%M%S%z.mp4","cpu":"3.2","cpu_average":"2","mem":"0.2"},"530":{"cmdline":"frigate.capture:front_doorbell","cpu":"3.7","cpu_average":"2","mem":"0.8"},"534":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/garage_rear -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/garage_rear@%Y%m%d%H%M%S%z.mp4","cpu":"2.6","cpu_average":"2","mem":"0.2"},"536":{"cmdline":"frigate.capture:back_doorbell","cpu":"2.9","cpu_average":"2","mem":"0.7"},"544":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/house_side -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/house_side@%Y%m%d%H%M%S%z.mp4","cpu":"2.6","cpu_average":"2","mem":"0.2"},"545":{"cmdline":"frigate.capture:garage_side","cpu":"2.9","cpu_average":"2","mem":"0.7"},"547":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://192.168.1.80:8557/back_doorbell -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/back_doorbell@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale=1296:1728 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"24.4","cpu_average":"19","mem":"0.5"},"552":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/garage_side_sub -r 5 -vf fps=5,scale=1920:1080 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"18.1","cpu_average":"12","mem":"0.5"},"557":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/garage_side -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/garage_side@%Y%m%d%H%M%S%z.mp4","cpu":"2.6","cpu_average":"2","mem":"0.2"},"87868":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/house_back1_sub -r 5 -vf fps=5,scale=1920:1080 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"20.4","cpu_average":"12","mem":"0.5"},"87870":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/house_back1 -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/house_back1@%Y%m%d%H%M%S%z.mp4","cpu":"2.6","cpu_average":"2","mem":"0.2"},"626114":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://192.168.1.80:8557/front-doorbell -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/front_doorbell@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale=1296:1728 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"21.2","cpu_average":"19","mem":"0.4"},"1474208":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/driveway_sub -r 5 -vf fps=5,scale=1920:1080 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"20.1","cpu_average":"8","mem":"0.4"},"1474210":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.13.0-614a36a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/driveway -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -c:a aac /tmp/cache/driveway@%Y%m%d%H%M%S%z.mp4","cpu":"3.2","cpu_average":"2","mem":"0.2"},"1836560":{"cmdline":"sleep 30s","cpu":"0.0","cpu_average":"0","mem":"0.0"}},"detection_fps":13.2,"detectors":{"coral":{"detection_start":0.0,"inference_speed":5.58,"pid":452}},"processes":{"go2rtc":{"pid":89},"logger":{"pid":440},"recording":{"pid":443}},"service":{"last_updated":1701355018,"latest_version":"0.12.1","storage":{"/dev/shm":{"free":481.1,"mount_type":"tmpfs","total":512.0,"used":30.9},"/media/frigate/clips":{"free":4090882.5,"mount_type":"cifs","total":5721128.5,"used":1630246.0},"/media/frigate/recordings":{"free":4090882.5,"mount_type":"cifs","total":5721128.5,"used":1630246.0},"/tmp/cache":{"free":909.1,"mount_type":"tmpfs","total":953.7,"used":44.5}},"temperatures":{},"uptime":224458,"version":"0.13.0-614a36a"}}

Operating system

Ubuntu 22.10

Install method

Docker Compose

Coral version

USB

Network connection

Wired

Camera make and model

amcrest

Any other information that may be helpful

Ubuntu 22.10

NickM-27 commented 11 months ago

your logs are full of camera errors, so it makes sense that recordings would be missing.

looks like camera timeouts rtsp://127.0.0.1:8554/house_back1: Connection timed out and other issues, I'd suggest checking go2rtc logs

superdong69 commented 11 months ago

Go2rtc logs:

2023-11-27 19:15:45.513907862  [INFO] Preparing new go2rtc config...
2023-11-27 19:15:45.806204672  [INFO] Not injecting WebRTC candidates into go2rtc config as it has been set manually
2023-11-27 19:15:45.834912613  [INFO] Starting go2rtc...
2023-11-27 19:15:45.898845349  19:15:45.898 INF go2rtc version 1.8.4 linux/amd64
2023-11-27 19:15:45.899231875  19:15:45.899 INF [api] listen addr=:1984
2023-11-27 19:15:45.899348986  19:15:45.899 INF [rtsp] listen addr=:8554
2023-11-27 19:15:45.899676490  19:15:45.899 INF [webrtc] listen addr=:8555
2023-11-27 19:15:55.510650242  [INFO] Starting go2rtc healthcheck service...
2023-11-27 22:48:33.633564842  22:48:33.633 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:171 > error=EOF url=rtsp://user:pass@192.168.1.91:554/cam/realmonitor?channel=1&subtype=2&unicast=true&proto=Onvif
2023-11-27 22:48:33.750345268  22:48:33.750 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:171 > error=EOF url=rtsp://user:pass@192.168.1.91:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
2023-11-27 22:48:56.829952667  22:48:56.829 WRN [rtsp] error="streams: dial tcp 192.168.1.91:554: i/o timeout" stream=house_back1_sub
2023-11-27 22:48:56.841468564  22:48:56.841 WRN [rtsp] error="streams: dial tcp 192.168.1.91:554: i/o timeout" stream=house_back1
2023-11-27 22:49:03.926846056  22:49:03.926 WRN [rtsp] error="streams: dial tcp 192.168.1.91:554: i/o timeout, dial tcp 192.168.1.91:554: connect: no route to host" stream=house_back1_sub
2023-11-27 22:49:03.926886707  22:49:03.926 WRN [rtsp] error="streams: dial tcp 192.168.1.91:554: i/o timeout, dial tcp 192.168.1.91:554: connect: no route to host" stream=house_back1
2023-11-27 22:49:14.268876816  22:49:14.268 WRN [rtsp] error="streams: dial tcp 192.168.1.91:554: connect: no route to host, dial tcp 192.168.1.91:554: connect: connection refused" stream=house_back1_sub
2023-11-27 22:49:14.268905176  22:49:14.268 WRN [rtsp] error="streams: dial tcp 192.168.1.91:554: connect: no route to host, dial tcp 192.168.1.91:554: connect: connection refused" stream=house_back1
2023-11-27 22:49:20.930137238  22:49:20.930 WRN [rtsp] error="streams: dial tcp 192.168.1.91:554: connect: connection refused" stream=house_back1_sub
2023-11-27 22:49:20.940057579  22:49:20.940 WRN [rtsp] error="streams: dial tcp 192.168.1.91:554: connect: connection refused" stream=house_back1
2023-11-29 21:30:22.781702678  21:30:22.781 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:171 > error="read tcp 172.18.0.2:47520->192.168.1.95:554: i/o timeout" url=rtsp://user:pass@192.168.1.95:554/cam/realmonitor?channel=1&subtype=2&unicast=true&proto=Onvif
2023-11-29 21:30:24.159349305  21:30:24.159 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:171 > error="read tcp 172.18.0.2:47516->192.168.1.95:554: i/o timeout" url=rtsp://user:pass@192.168.1.95:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
2023-11-29 21:30:43.741762306  21:30:43.741 WRN [rtsp] error="streams: dial tcp 192.168.1.95:554: i/o timeout" stream=driveway_sub
2023-11-29 21:30:43.761010738  21:30:43.760 WRN [rtsp] error="streams: dial tcp 192.168.1.95:554: i/o timeout" stream=driveway
2023-11-29 21:30:50.780845401  21:30:50.780 WRN [rtsp] error="streams: dial tcp 192.168.1.95:554: i/o timeout, dial tcp 192.168.1.95:554: connect: connection refused" stream=driveway_sub
2023-11-29 21:30:50.793585531  21:30:50.793 WRN [rtsp] error="streams: dial tcp 192.168.1.95:554: i/o timeout, dial tcp 192.168.1.95:554: connect: connection refused" stream=driveway
2023-11-29 21:30:57.810116272  21:30:57.809 WRN [rtsp] error="streams: dial tcp 192.168.1.95:554: connect: connection refused" stream=driveway_sub
2023-11-29 21:30:57.820970813  21:30:57.820 WRN [rtsp] error="streams: dial tcp 192.168.1.95:554: connect: connection refused" stream=driveway
NickM-27 commented 11 months ago

looks like cameras are dropping off the network and refusing connections

superdong69 commented 11 months ago

Yeah, I'm not sure what or how on that one. I never see them dropping. I've run ping traces on them, and never drop packets...strange. Any recommendations on how I can test this out?

superdong69 commented 11 months ago

So I set up prtg net mon on the network, created a group and assigned all the cameras to it, assigned ping sensors to each camera, and set notification triggers for ping so if the camera drops network connection for 1 sec, I'll get notified. Wondering if the POE switch is flaky.

github-actions[bot] commented 10 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.