search

blakeblackshear / frigate

NVR with realtime local object detection for IP cameras
https://frigate.video
MIT License
17.18k stars 1.59k forks source link

[HW Accel Support]: 0.13 - Some Camera ONVIF Implementations Not Supported #7384

Open Majestic7979 opened 1 year ago

Majestic7979 commented 1 year ago

Describe the problem you are having

Made my config stable with help from Nick. Now testing 0.13 in preparation for deployment when it is released. Having issues with audio recognition not working - ffmpeg restarts, says it cannot recognize the audio.

Having tensorrt serialization problems. Detector doesn't work.

Imagine does not load from camera.

Used to be able to fetch snapshot but it's not working - may be related to the fact that there's no image... so can't generate snapshot, but unsure.

s6-rc: info: service trt-model-prepare successfully started
s6-rc: info: service log-prepare successfully started
s6-rc: info: service nginx-log: starting
s6-rc: info: service go2rtc-log: starting
s6-rc: info: service frigate-log: starting
s6-rc: info: service nginx-log successfully started
s6-rc: info: service go2rtc-log successfully started
s6-rc: info: service go2rtc: starting
s6-rc: info: service frigate-log successfully started
s6-rc: info: service go2rtc successfully started
s6-rc: info: service go2rtc-healthcheck: starting
s6-rc: info: service frigate: starting
s6-rc: info: service go2rtc-healthcheck successfully started
s6-rc: info: service frigate successfully started
s6-rc: info: service nginx: starting
s6-rc: info: service nginx successfully started
s6-rc: info: service legacy-services: starting
2023-08-03 19:51:06.717717608  [INFO] Preparing Frigate...
2023-08-03 19:51:06.718830254  [INFO] Starting NGINX...
2023-08-03 19:51:06.721535317  [INFO] Preparing go2rtc config...
s6-rc: info: service legacy-services successfully started
2023-08-03 19:51:06.727227231  [INFO] Starting Frigate...
2023-08-03 19:51:06.904793948  [INFO] Starting go2rtc...
2023-08-03 19:51:06.971674419  19:51:06.971 INF go2rtc version 1.6.2 linux/amd64
2023-08-03 19:51:06.971784384  19:51:06.971 INF [api] listen addr=0.0.0.0:1984
2023-08-03 19:51:06.971868322  19:51:06.971 INF [rtsp] listen addr=0.0.0.0:8554
2023-08-03 19:51:06.971922109  19:51:06.971 INF [webrtc] listen addr=0.0.0.0:8555/tcp
2023-08-03 19:51:06.972036173  19:51:06.972 INF [srtp] listen addr=0.0.0.0:8443
2023-08-03 19:51:07.399630917  2023/08/03 19:51:07 [error] 155#155: *2 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.z, server: , request: "GET /api/frigate_backyard/latest.jpg?h=90 HTTP/1.1", upstream: "http://127.0.0.1:5001frigate_backyard/latest.jpg?h=90", host: "x.x.x.x:5000"
2023-08-03 19:51:07.399650528  x.x.x.z - - [03/Aug/2023:19:51:07 +0100] "GET /api/frigate_backyard/latest.jpg?h=90 HTTP/1.1" 502 157 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 19:51:07.399972400  2023/08/03 19:51:07 [error] 155#155: *1 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.z, server: , request: "GET /api/frigate_street_nw/latest.jpg?h=148 HTTP/1.1", upstream: "http://127.0.0.1:5001frigate_street_nw/latest.jpg?h=148", host: "x.x.x.x:5000"
2023-08-03 19:51:07.399979754  x.x.x.z - - [03/Aug/2023:19:51:07 +0100] "GET /api/frigate_street_nw/latest.jpg?h=148 HTTP/1.1" 502 157 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 19:51:07.405180863  [2023-08-03 19:51:07] frigate.app                    INFO    : Starting Frigate (0.13.0-9857641)
2023-08-03 19:51:07.431249338  2023/08/03 19:51:07 [error] 154#154: *5 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.z, server: , request: "GET /api/frigate_street_nw/latest.jpg?h=90 HTTP/1.1", upstream: "http://127.0.0.1:5001frigate_street_nw/latest.jpg?h=90", host: "x.x.x.x:5000"
2023-08-03 19:51:07.431288464  x.x.x.z - - [03/Aug/2023:19:51:07 +0100] "GET /api/frigate_street_nw/latest.jpg?h=90 HTTP/1.1" 502 157 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 19:51:07.463379728  2023/08/03 19:51:07 [error] 157#157: *7 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.z, server: , request: "GET /api/frigate_street_se/latest.jpg?h=90 HTTP/1.1", upstream: "http://127.0.0.1:5001frigate_street_se/latest.jpg?h=90", host: "x.x.x.x:5000"
2023-08-03 19:51:07.463393125  x.x.x.z - - [03/Aug/2023:19:51:07 +0100] "GET /api/frigate_street_se/latest.jpg?h=90 HTTP/1.1" 502 157 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 19:51:07.463826161  2023/08/03 19:51:07 [error] 157#157: *8 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.z, server: , request: "GET /api/frigate_street_front/latest.jpg?h=90 HTTP/1.1", upstream: "http://127.0.0.1:5001frigate_street_front/latest.jpg?h=90", host: "x.x.x.x:5000"
2023-08-03 19:51:07.463832609  x.x.x.z - - [03/Aug/2023:19:51:07 +0100] "GET /api/frigate_street_front/latest.jpg?h=90 HTTP/1.1" 502 157 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 19:51:07.467905316  [2023-08-03 19:51:07] peewee_migrate.logs            INFO    : Starting migrations
2023-08-03 19:51:07.469914651  [2023-08-03 19:51:07] peewee_migrate.logs            INFO    : There is nothing to migrate
2023-08-03 19:51:08.391808902  [2023-08-03 19:51:08] frigate.app                    INFO    : Recording process started: 881
2023-08-03 19:51:08.394765009  [2023-08-03 19:51:08] frigate.app                    INFO    : go2rtc process pid: 98
2023-08-03 19:51:08.408733199  [2023-08-03 19:51:08] detector.tensorrt              INFO    : Starting detection process: 890
2023-08-03 19:51:08.457238733  [2023-08-03 19:51:08] frigate.app                    INFO    : Output process started: 892
2023-08-03 19:51:08.457327237  [2023-08-03 19:51:08] frigate.app                    INFO    : Camera processor started for frigate_street_front: 896
2023-08-03 19:51:08.457342743  [2023-08-03 19:51:08] frigate.app                    INFO    : Camera processor started for frigate_street_nw: 898
2023-08-03 19:51:08.457359403  [2023-08-03 19:51:08] frigate.app                    INFO    : Camera processor started for frigate_street_se: 900
2023-08-03 19:51:08.457374557  [2023-08-03 19:51:08] frigate.app                    INFO    : Camera processor started for frigate_backyard: 903
2023-08-03 19:51:08.457390604  [2023-08-03 19:51:08] frigate.app                    INFO    : Capture process started for frigate_street_front: 905
2023-08-03 19:51:08.457405338  [2023-08-03 19:51:08] frigate.app                    INFO    : Capture process started for frigate_street_nw: 910
2023-08-03 19:51:08.457419547  [2023-08-03 19:51:08] frigate.app                    INFO    : Capture process started for frigate_street_se: 914
2023-08-03 19:51:08.457434295  [2023-08-03 19:51:08] frigate.app                    INFO    : Capture process started for frigate_backyard: 918
2023-08-03 19:51:08.457448497  [2023-08-03 19:51:08] frigate.app                    INFO    : Audio process started: 924
2023-08-03 19:51:08.638312074  [2023-08-03 19:51:08] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 34 MiB
2023-08-03 19:51:08.694171580  [2023-08-03 19:51:08] frigate.detectors.plugins.tensorrt ERROR   : 1: [stdArchiveReader.cpp::StdArchiveReader::42] Error Code 1: Serialization (Serialization assertion stdVersionRead == serializationVersion failed.Version tag does not match. Note: Current Version: 232, Serialized Engine Version: 213)
2023-08-03 19:51:08.699180837  Process detector:tensorrt:
2023-08-03 19:51:08.699313585  [2023-08-03 19:51:08] frigate.detectors.plugins.tensorrt ERROR   : 4: [runtime.cpp::deserializeCudaEngine::66] Error Code 4: Internal Error (Engine deserialization failed.)
2023-08-03 19:51:08.699522568  Traceback (most recent call last):
2023-08-03 19:51:08.699524371    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2023-08-03 19:51:08.699525191      self.run()
2023-08-03 19:51:08.699525906    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2023-08-03 19:51:08.699526564      self._target(*self._args, **self._kwargs)
2023-08-03 19:51:08.699527609    File "/opt/frigate/frigate/object_detection.py", line 102, in run_detector
2023-08-03 19:51:08.699529342      object_detector = LocalObjectDetector(detector_config=detector_config)
2023-08-03 19:51:08.699545557    File "/opt/frigate/frigate/object_detection.py", line 53, in __init__
2023-08-03 19:51:08.699546344      self.detect_api = create_detector(detector_config)
2023-08-03 19:51:08.699547015    File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
2023-08-03 19:51:08.699566115      return api(detector_config)
2023-08-03 19:51:08.699566924    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 221, in __init__
2023-08-03 19:51:08.699567622      self.input_shape = self._get_input_shape()
2023-08-03 19:51:08.699568234    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 93, in _get_input_shape
2023-08-03 19:51:08.699574543      binding = self.engine[0]
2023-08-03 19:51:08.699575118  TypeError: 'NoneType' object is not subscriptable
2023-08-03 19:51:08.699575766  Exception ignored in: <function TensorRtDetector.__del__ at 0x7f71a3f9ba60>
2023-08-03 19:51:08.699576424  Traceback (most recent call last):
2023-08-03 19:51:08.699577015    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 239, in __del__
2023-08-03 19:51:08.699585622      if self.outputs is not None:
2023-08-03 19:51:08.699586287  AttributeError: 'TensorRtDetector' object has no attribute 'outputs'
2023-08-03 19:51:10.616240846  [2023-08-03 19:51:10] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 19:51:10.945974256  [2023-08-03 19:51:10] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 19:51:12.335010496  [2023-08-03 19:51:12] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 19:51:14.085690081  x.x.x.z - - [03/Aug/2023:19:51:14 +0100] "GET /api/stats HTTP/1.1" 200 11124 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"

Version

0.13.0-9857641

Frigate config file

####################################
########## FRIGATE CONFIG ##########

mqtt:
  enabled: false

detectors:
  tensorrt:
    type: tensorrt
    device: 0

model:
  path: /trt-models/yolov7-tiny-416.trt
  input_tensor: nchw
  input_pixel_format: rgb
  width: 416
  height: 416

ui:
  live_mode: jsmpeg
  timezone: Europe/London
  use_experimental: False
  time_format: 12hour
  date_style: short
  time_style: medium
  strftime_fmt: "%Y/%m/%d %H:%M"

logger:
  default: info
  logs:
    frigate.event: info
    frigate.record: debug

database:
  path: /db/frigate.db

birdseye:
  enabled: True
  restream: True
  width: 1280
  height: 960
    # 1 is the highest quality, and 31 is the lowest. Lower quality feeds utilize less CPU resources.
  quality: 10
  mode: continuous

detect:
  width: 1280
  height: 960
  fps: 5
  enabled: true
  max_disappeared: 60

audio:
  enabled: True
  max_not_heard: 30
  min_volume: 500
  listen:
    - bark
    - scream
    - yell
    - speech
  filters:
    speech:
      threshold: 0.8

objects:
  track:
    - person

record:
  enabled: True
  retain:
    days: 15
    mode: all
  events:
    retain:
      default: 15

snapshots:
  enabled: False
  timestamp: true
  bounding_box: False
  crop: False
  retain:
    default: 5

rtmp:
  enabled: False

timestamp_style:
    # "tl" (top left), "tr" (top right), "bl" (bottom left), "br" (bottom right)
  position: "tl"
    # Optional: Format specifier conform to the Python package "datetime" (default: shown below)
    #           Additional Examples:
    #             german: "%d.%m.%Y %H:%M:%S"
  format: "%m/%d/%Y %H:%M:%S"
  color:
    red: 255
    green: 255
    blue: 255
  thickness: 2
    # None (No effect),
    # "solid" (solid background in inverse color of font)
    # "shadow" (shadow for font)
  effect: shadow

telemetry:
  network_interfaces:
    - eth
    - enp
    - eno
    - ens
    - wl
    - lo
  stats:
    intel_gpu_stats: True
    network_bandwidth: True
  version_check: True
###################################
########## CAMERA CONFIG ##########

cameras:
  frigate_street_front:
    onvif:
      host: x.x.x.b
      port: 80
      user: noneof
      password: yourbusiness
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/front
          input_args: preset-rtsp-restream-low-latency #preset-rtsp-generic
          roles:
            - record
            - audio
            - detect
    detect:
      enabled: true

  frigate_street_nw:
    onvif:
      host: x.x.x.c
      port: 80
      user: noneof
      password: yourbusiness
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/nw
          input_args: preset-rtsp-restream-low-latency #preset-rtsp-generic
          roles:
            - record
            - audio
            - detect
    detect:
      enabled: true

  frigate_street_se:
    onvif:
      host: x.x.x.a
      port: 80
      user: noneof
      password: yourbusiness
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/se
          input_args: preset-rtsp-restream-low-latency #preset-rtsp-generic
          roles:
            - record
            - audio
            - detect
    detect:
      enabled: true

  frigate_backyard:
    onvif:
      host: x.x.x.d
      port: 80
      user: noneof
      password: yourbusiness
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/backyard
          input_args: preset-rtsp-restream-low-latency #preset-rtsp-generic
          roles:
            - record
            - audio
            - detect
    detect:
      enabled: true

### docker-compose file or Docker CLI command

```yaml
docker create --name=frigate --restart=unless-stopped -p 5000:5000 -p 8551:8554 -p 1988:1984 -p 8552:8555 --gpus=all --cap-add=CAP_PERFMON --mount type=tmpfs,target=/tmp/cache,tmpfs-size=2000000000 --shm-size=1g --device /dev/bus/usb:/dev/bus/usb --device /dev/dri/renderD128 -v /cctv:/media/frigate -v /home/user/docker/frigate/config.yml:/config/config.yml -v /home/user/docker/frigate/db/:/db/ -v /etc/localtime:/etc/localtime:ro -v /home/user/trt-models:/trt-models -e FRIGATE_RTSP_PASSWORD='FATCHANCE!' -e NVIDIA_VISIBLE_DEVICES=all -e NVIDIA_DRIVER_CAPABILITIES=compute,video,utility -e YOLO_MODELS=yolov7-tiny-416 ghcr.io/blakeblackshear/frigate:dev-9857641-tensorrt &&  docker start frigate

### Relevant log output

```shell
As above...

FFprobe output from your camera

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"0/0","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1944,"width":2592},{"avg_frame_rate":"0/0","bit_rate":"64000","codec_long_name":"PCMA-law/G.711A-law"}]}}]


### Operating system

Debian

### Install method

Docker CLI

### Network connection

Wired

### Camera make and model

Anpviz 5MP Zoom

### Any other information that may be helpful

Ask me anything
NickM-27 commented 1 year ago
  1. You need to map the entire /config directory not just /config/config.yml for 0.13 so that the tensorrt models are not generated every time frigate starts
  2. What version of the nvidia driver do you have on the host?
NickM-27 commented 1 year ago

Actually yeah that is the problem, old tensorrt models are being used with the newer version. Should be following the 0.13 docs: https://deploy-preview-6262--frigate-docs.netlify.app/configuration/object_detectors#nvidia-tensorrt-detector

Majestic7979 commented 1 year ago

I noticed this before your comment. I will remap /config. I manually deleted the trt-models folder... I noticed it's now in a different path /config/model_cache/tensorrt after comparing my config with the new documentation. Let me see what happens.

Majestic7979 commented 1 year ago 
1
2023-08-03 20:38:19.273565573  [2023-08-03 20:38:19] frigate.app                    INFO    : Capture process started for frigate_backyard: 916
2023-08-03 20:38:19.499977104  [2023-08-03 20:38:19] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 176 MiB
2023-08-03 20:38:19.715356405  [2023-08-03 20:38:19] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +193, GPU +74, now: CPU 687, GPU 500 (MiB)
2023-08-03 20:38:19.792908963  [2023-08-03 20:38:19] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +110, GPU +46, now: CPU 797, GPU 546 (MiB)
2023-08-03 20:38:19.793972181  [2023-08-03 20:38:19] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +176, now: CPU 0, GPU 176 (MiB)
2023-08-03 20:38:19.796051777  /usr/local/lib/python3.9/dist-packages/tensorrt/__init__.py:166: FutureWarning: In the future `np.bool` will be defined as the corresponding NumPy scalar.
2023-08-03 20:38:19.796052946    bool: np.bool,
2023-08-03 20:38:19.796117838  Process detector:tensorrt:
2023-08-03 20:38:19.796443838  Traceback (most recent call last):
2023-08-03 20:38:19.796464413    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2023-08-03 20:38:19.796465369      self.run()
2023-08-03 20:38:19.796466267    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2023-08-03 20:38:19.796467037      self._target(*self._args, **self._kwargs)
2023-08-03 20:38:19.796469930    File "/opt/frigate/frigate/object_detection.py", line 102, in run_detector
2023-08-03 20:38:19.796471394      object_detector = LocalObjectDetector(detector_config=detector_config)
2023-08-03 20:38:19.796472320    File "/opt/frigate/frigate/object_detection.py", line 53, in __init__
2023-08-03 20:38:19.796484806      self.detect_api = create_detector(detector_config)
2023-08-03 20:38:19.796489930    File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
2023-08-03 20:38:19.796490755      return api(detector_config)
2023-08-03 20:38:19.796491613    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 221, in __init__
2023-08-03 20:38:19.796492373      self.input_shape = self._get_input_shape()
2023-08-03 20:38:19.796493274    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 99, in _get_input_shape
2023-08-03 20:38:19.796494049      trt.nptype(self.engine.get_binding_dtype(binding)),
2023-08-03 20:38:19.796494890    File "/usr/local/lib/python3.9/dist-packages/tensorrt/__init__.py", line 166, in nptype
2023-08-03 20:38:19.796495527      bool: np.bool,
2023-08-03 20:38:19.796496523    File "/usr/local/lib/python3.9/dist-packages/numpy/__init__.py", line 313, in __getattr__
2023-08-03 20:38:19.796497528      raise AttributeError(__former_attrs__[attr])
2023-08-03 20:38:19.796498257  AttributeError: module 'numpy' has no attribute 'bool'.
2023-08-03 20:38:19.796517161  `np.bool` was a deprecated alias for the builtin `bool`. To avoid this error in existing code, use `bool` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.bool_` here.
2023-08-03 20:38:19.796531023  The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at:
2023-08-03 20:38:19.796532105      https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
2023-08-03 20:38:19.796537613  Exception ignored in: <function TensorRtDetector.__del__ at 0x7f29c71bc9d0>
2023-08-03 20:38:19.796538459  Traceback (most recent call last):
2023-08-03 20:38:19.796539331    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 239, in __del__
2023-08-03 20:38:19.796543266      if self.outputs is not None:
2023-08-03 20:38:19.796546909  AttributeError: 'TensorRtDetector' object has no attribute 'outputs'
2023-08-03 20:38:25.142574563  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/stats HTTP/1.1" 200 10277 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:25.471440093  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/frigate_street_front/latest.jpg?h=90 HTTP/1.1" 200 1591 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:25.483701851  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/frigate_street_se/latest.jpg?h=90 HTTP/1.1" 200 1591 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:25.487102085  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/frigate_street_nw/latest.jpg?h=90 HTTP/1.1" 200 1591 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:25.487506031  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/frigate_backyard/latest.jpg?h=90 HTTP/1.1" 200 1591 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:25.892884275  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/frigate_street_front/latest.jpg?h=148 HTTP/1.1" 200 2624 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:25.897142484  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/frigate_backyard/latest.jpg?h=148 HTTP/1.1" 200 2624 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:25.901039463  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/frigate_street_se/latest.jpg?h=148 HTTP/1.1" 200 2624 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:25.943720754  10.0.0.211 - - [03/Aug/2023:20:38:25 +0100] "GET /api/frigate_street_nw/latest.jpg?h=148 HTTP/1.1" 200 2624 "-" "HomeAssistant/2023.8.0 aiohttp/3.8.5 Python/3.11" "-"
2023-08-03 20:38:28.028394661  [INFO] Starting go2rtc healthcheck service...

Still no dice.

Majestic7979 commented 1 year ago

You also asked me which nvidia version:

nvidia-smi
Thu Aug  3 20:41:42 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.125.06   Driver Version: 525.125.06   CUDA Version: 12.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  On   | 00000000:01:00.0 Off |                  N/A |
|  0%   57C    P8    12W / 240W |     54MiB /  8192MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A      1374      G   /usr/lib/xorg/Xorg                 26MiB |
|    0   N/A  N/A      1407      G   /usr/bin/sddm-greeter              25MiB |
+-----------------------------------------------------------------------------+
Majestic7979 commented 1 year ago 
####################################
########## FRIGATE CONFIG ##########

mqtt:
  enabled: false

detectors:
  tensorrt:
    type: tensorrt
    device: 0

model:
  path: /config/model_cache/tensorrt/yolov7-320.trt
  input_tensor: nchw
  input_pixel_format: rgb
  width: 320
  height: 320

ui:
  live_mode: jsmpeg
  timezone: Europe/London
  use_experimental: False
  time_format: 12hour
  date_style: short
  time_style: medium
  strftime_fmt: "%Y/%m/%d %H:%M"

logger:
  default: info
  logs:
    frigate.event: info
    frigate.record: debug

database:
  path: /db/frigate.db

birdseye:
  enabled: True
  restream: True
  width: 1280
  height: 960
    # 1 is the highest quality, and 31 is the lowest. Lower quality feeds utilize less CPU resources.
  quality: 10
  mode: continuous

detect:
  width: 1280
  height: 960
  fps: 5
  enabled: true
  max_disappeared: 60

audio:
  enabled: False
  max_not_heard: 30
  min_volume: 500
  listen:
    - bark
    - scream
    - yell
    - speech
  filters:
    speech:
      threshold: 0.8

objects:
  track:
    - person

record:
  enabled: True
  retain:
    days: 15
    mode: all
  events:
    retain:
      default: 15

snapshots:
  enabled: False
  timestamp: true
  bounding_box: False
  crop: False
  retain:
    default: 5

rtmp:
  enabled: False

timestamp_style:
    # "tl" (top left), "tr" (top right), "bl" (bottom left), "br" (bottom right)
  position: "tl"
    # Optional: Format specifier conform to the Python package "datetime" (default: shown below)
    #           Additional Examples:
    #             german: "%d.%m.%Y %H:%M:%S"
  format: "%m/%d/%Y %H:%M:%S"
  color:
    red: 255
    green: 255
    blue: 255
  thickness: 2
    # None (No effect),
    # "solid" (solid background in inverse color of font)
    # "shadow" (shadow for font)
  effect: shadow

telemetry:
  network_interfaces:
    - eth
    - enp
    - eno
    - ens
    - wl
    - lo
  stats:
    intel_gpu_stats: True
    network_bandwidth: True
  version_check: True

###################################
########## CAMERA CONFIG ##########

cameras:

  frigate_street_se:
    onvif:
      host: x.x.x.a
      port: 8091
      user: NONEOFBUSINESS
      password: FATCHANCE!
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/se
          input_args: preset-rtsp-generic
          roles:
            - record
            - audio
            - detect
    detect:
      enabled: true

  frigate_street_front:
    onvif:
      host: x.x.x.b
      port: 8091
      user: NONEOFBUSINESS
      password: FATCHANCE!
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/front
          input_args: preset-rtsp-generic
          roles:
            - record
            - audio
            - detect
    detect:
      enabled: true

  frigate_street_nw:
    onvif:
      host: x.x.x.c
      port: 8091
      user: NONEOFBUSINESS
      password: FATCHANCE!
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/nw
          input_args: preset-rtsp-generic
          roles:
            - record
            - audio
            - detect
    detect:
      enabled: true

  frigate_backyard:
    onvif:
      host: x.x.x.d
      port: 8091
      user: NONEOFBUSINESS
      password: FATCHANCE!
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/backyard
          input_args: preset-rtsp-generic
          roles:
            - record
            - audio
            - detect
    detect:
      enabled: true
NickM-27 commented 1 year ago

still no dice

That is a known issue which is fixed in https://github.com/blakeblackshear/frigate/pull/7348

I'd suggest running https://github.com/blakeblackshear/frigate/pkgs/container/frigate/113670771?tag=dev-f8c0f74 for now

Majestic7979 commented 1 year ago

What ports does Frigate 0.13 use when "everything" is enabled?

I am not getting any video now... same input URL as before and it works in VLC. Just a black screen with a ! inside a circle.

NickM-27 commented 1 year ago

What are the logs? And when you say you're not getting any video, where are you looking?

Majestic7979 commented 1 year ago

image

It looks like the footage is actually being recorded (I can browse and watch in the Recordings section of each cam) Logs follow in next post

Majestic7979 commented 1 year ago 
2023-08-03 21:10:50.856850371  [2023-08-03 21:10:50] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:10:50.856929414  [2023-08-03 21:10:50] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:10:52.215623774  [2023-08-03 21:10:52] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:10:53.323674354  [2023-08-03 21:10:53] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:10:54.823846671  [2023-08-03 21:10:54] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:02.224125658  [2023-08-03 21:11:02] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:02.224128014  [2023-08-03 21:11:02] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:03.332140588  [2023-08-03 21:11:03] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55bf259f1880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1152 >= 1152
2023-08-03 21:11:03.332215063  [2023-08-03 21:11:03] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55bf259f1880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 6320 >= 6320
2023-08-03 21:11:03.332267942  [2023-08-03 21:11:03] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55bf259f1880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 11376 >= 11376
2023-08-03 21:11:03.332316956  [2023-08-03 21:11:03] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55bf259f1880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 13984 >= 13984
2023-08-03 21:11:03.332370367  [2023-08-03 21:11:03] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:03.332450639  [2023-08-03 21:11:03] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:04.832200137  [2023-08-03 21:11:04] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:04.832291757  [2023-08-03 21:11:04] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:05.193863137  [2023-08-03 21:11:05] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:05.432645989  [2023-08-03 21:11:05] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:08.112836432  [2023-08-03 21:11:08] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:15.203873247  [2023-08-03 21:11:15] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:15.203909186  [2023-08-03 21:11:15] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:15.442715995  [2023-08-03 21:11:15] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x557829c5e1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 3488 >= 3488
2023-08-03 21:11:15.442750231  [2023-08-03 21:11:15] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x557829c5e1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 5904 >= 5536
2023-08-03 21:11:15.442770931  [2023-08-03 21:11:15] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x557829c5e1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 7904 >= 7904
2023-08-03 21:11:15.442789410  [2023-08-03 21:11:15] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x557829c5e1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 18208 >= 18208
2023-08-03 21:11:15.442807383  [2023-08-03 21:11:15] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:15.442824545  [2023-08-03 21:11:15] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:16.284625171  [2023-08-03 21:11:16] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_se
2023-08-03 21:11:16.285229488  [2023-08-03 21:11:16] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_backyard
2023-08-03 21:11:16.285437121  [2023-08-03 21:11:16] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_front
2023-08-03 21:11:16.285884316  [2023-08-03 21:11:16] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_nw
2023-08-03 21:11:17.509993035  [2023-08-03 21:11:17] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:18.119955007  [2023-08-03 21:11:18] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:18.119992489  [2023-08-03 21:11:18] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:18.325126414  [2023-08-03 21:11:18] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:22.952891909  [2023-08-03 21:11:22] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:27.521179810  [2023-08-03 21:11:27] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55fbce1a6600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 7488 >= 7488
2023-08-03 21:11:27.521375075  [2023-08-03 21:11:27] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55fbce1a6600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 20288 >= 20288
2023-08-03 21:11:27.521508620  [2023-08-03 21:11:27] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:27.521620431  [2023-08-03 21:11:27] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:28.333413845  [2023-08-03 21:11:28] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:28.333658480  [2023-08-03 21:11:28] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:29.636393846  [2023-08-03 21:11:29] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:30.396184650  [2023-08-03 21:11:30] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:32.964580389  [2023-08-03 21:11:32] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:32.964752492  [2023-08-03 21:11:32] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:39.648594473  [2023-08-03 21:11:39] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55cddcbdaf40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 10448 >= 10448
2023-08-03 21:11:39.648788128  [2023-08-03 21:11:39] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55cddcbdaf40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 17904 >= 17904
2023-08-03 21:11:39.648916853  [2023-08-03 21:11:39] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55cddcbdaf40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 28144 >= 28144
2023-08-03 21:11:39.649015790  [2023-08-03 21:11:39] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:39.649119218  [2023-08-03 21:11:39] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:39.856189065  [2023-08-03 21:11:39] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:40.404857947  [2023-08-03 21:11:40] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:40.405064151  [2023-08-03 21:11:40] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:44.352676918  [2023-08-03 21:11:44] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:44.516610749  [2023-08-03 21:11:44] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:49.864798702  [2023-08-03 21:11:49] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:49.865002359  [2023-08-03 21:11:49] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:52.198227358  [2023-08-03 21:11:52] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:11:54.361210561  [2023-08-03 21:11:54] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x5588a2a77f40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 52192 >= 52192
2023-08-03 21:11:54.361477545  [2023-08-03 21:11:54] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:54.361691028  [2023-08-03 21:11:54] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:54.527169893  [2023-08-03 21:11:54] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55db1a8c3b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 3168 >= 3168
2023-08-03 21:11:54.527424226  [2023-08-03 21:11:54] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55db1a8c3b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 15952 >= 15952
2023-08-03 21:11:54.527652393  [2023-08-03 21:11:54] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55db1a8c3b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 18816 >= 18816
2023-08-03 21:11:54.527845808  [2023-08-03 21:11:54] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55db1a8c3b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 33936 >= 33936
2023-08-03 21:11:54.528036223  [2023-08-03 21:11:54] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55db1a8c3b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 57104 >= 57104
2023-08-03 21:11:54.528236955  [2023-08-03 21:11:54] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55db1a8c3b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 59536 >= 59536
2023-08-03 21:11:54.528444195  [2023-08-03 21:11:54] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55db1a8c3b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 79988 >= 79988
2023-08-03 21:11:54.528645411  [2023-08-03 21:11:54] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:11:54.528816498  [2023-08-03 21:11:54] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:11:59.399776338  [2023-08-03 21:11:59] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:00.293433393  [2023-08-03 21:12:00] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:02.209168484  [2023-08-03 21:12:02] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:02.209436723  [2023-08-03 21:12:02] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:04.198377762  [2023-08-03 21:12:04] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:09.411169794  [2023-08-03 21:12:09] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x5592f79fecc0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 56912 >= 56912
2023-08-03 21:12:09.411364293  [2023-08-03 21:12:09] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x5592f79fecc0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 59488 >= 59488
2023-08-03 21:12:09.411484628  [2023-08-03 21:12:09] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:09.411669762  [2023-08-03 21:12:09] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:10.299936556  [2023-08-03 21:12:10] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55c40623cf40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 6752 >= 6752
2023-08-03 21:12:10.300024830  [2023-08-03 21:12:10] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:10.300047328  [2023-08-03 21:12:10] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:12.141101416  [2023-08-03 21:12:12] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:14.209002403  [2023-08-03 21:12:14] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:14.209248843  [2023-08-03 21:12:14] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:19.072032673  [2023-08-03 21:12:19] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:19.095449552  [2023-08-03 21:12:19] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:22.149308689  [2023-08-03 21:12:22] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55958e372880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 4080 >= 4080
2023-08-03 21:12:22.149528424  [2023-08-03 21:12:22] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55958e372880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 12880 >= 12880
2023-08-03 21:12:22.149679420  [2023-08-03 21:12:22] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:22.149805265  [2023-08-03 21:12:22] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:24.169619110  [2023-08-03 21:12:24] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:29.080073377  [2023-08-03 21:12:29] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55d234b34600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 5296 >= 5296
2023-08-03 21:12:29.080111690  [2023-08-03 21:12:29] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:29.080138308  [2023-08-03 21:12:29] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:29.104641158  [2023-08-03 21:12:29] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x564286c35440] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 83536 >= 83536
2023-08-03 21:12:29.104701169  [2023-08-03 21:12:29] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:29.104746951  [2023-08-03 21:12:29] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:33.001488954  [2023-08-03 21:12:33] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:33.007590883  [2023-08-03 21:12:33] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:34.175964975  [2023-08-03 21:12:34] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55d1a72c2880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 7808 >= 7808
2023-08-03 21:12:34.176005240  [2023-08-03 21:12:34] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:34.176031392  [2023-08-03 21:12:34] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:37.171631342  [2023-08-03 21:12:37] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:43.007880683  [2023-08-03 21:12:43] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:43.007901667  [2023-08-03 21:12:43] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:43.015976817  [2023-08-03 21:12:43] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:43.016031361  [2023-08-03 21:12:43] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:46.181399962  [2023-08-03 21:12:46] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:46.959478098  [2023-08-03 21:12:46] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:47.180168348  [2023-08-03 21:12:47] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55eac915fd40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1168 >= 1168
2023-08-03 21:12:47.180207284  [2023-08-03 21:12:47] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55eac915fd40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 5376 >= 5376
2023-08-03 21:12:47.180228100  [2023-08-03 21:12:47] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55eac915fd40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 14016 >= 14016
2023-08-03 21:12:47.180244960  [2023-08-03 21:12:47] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55eac915fd40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 26784 >= 26784
2023-08-03 21:12:47.180260398  [2023-08-03 21:12:47] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55eac915fd40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 32000 >= 32000
2023-08-03 21:12:47.180275867  [2023-08-03 21:12:47] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55eac915fd40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 35280 >= 35280
2023-08-03 21:12:47.180291681  [2023-08-03 21:12:47] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:47.180307979  [2023-08-03 21:12:47] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:50.509346598  [2023-08-03 21:12:50] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:12:56.187888576  [2023-08-03 21:12:56] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:56.187910907  [2023-08-03 21:12:56] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:56.967903112  [2023-08-03 21:12:56] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:12:56.967940240  [2023-08-03 21:12:56] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:12:58.186113481  [2023-08-03 21:12:58] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:00.515928271  [2023-08-03 21:13:00] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55934da7ff40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 3200 >= 3200
2023-08-03 21:13:00.515944529  [2023-08-03 21:13:00] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55934da7ff40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 13456 >= 13456
2023-08-03 21:13:00.515977362  [2023-08-03 21:13:00] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55934da7ff40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 24208 >= 24208
2023-08-03 21:13:00.516001257  [2023-08-03 21:13:00] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:00.516005411  [2023-08-03 21:13:00] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:00.788995158  [2023-08-03 21:13:00] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:02.510206616  [2023-08-03 21:13:02] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:08.196925450  [2023-08-03 21:13:08] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:08.197121388  [2023-08-03 21:13:08] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:10.189947963  [2023-08-03 21:13:10] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:10.796958589  [2023-08-03 21:13:10] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:10.797206310  [2023-08-03 21:13:10] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:10.855187947  [2023-08-03 21:13:10] audio.frigate_backyard         ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:12.521393333  [2023-08-03 21:13:12] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x5636c043a1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 15344 >= 15344
2023-08-03 21:13:12.521732466  [2023-08-03 21:13:12] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x5636c043a1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 25568 >= 25568
2023-08-03 21:13:12.521808095  [2023-08-03 21:13:12] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:12.521970447  [2023-08-03 21:13:12] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:12.807075972  [2023-08-03 21:13:12] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:14.870088191  [2023-08-03 21:13:14] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:20.196945756  [2023-08-03 21:13:20] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:20.197136875  [2023-08-03 21:13:20] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:20.867327352  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 44112 >= 44112
2023-08-03 21:13:20.867505765  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 113440 >= 113440
2023-08-03 21:13:20.867711604  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 240672 >= 240672
2023-08-03 21:13:20.867754201  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 267504 >= 267504
2023-08-03 21:13:20.867900009  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 334644 >= 334644
2023-08-03 21:13:20.867937992  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 365428 >= 365428
2023-08-03 21:13:20.868078806  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 373684 >= 373684
2023-08-03 21:13:20.868089222  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 464074 >= 464074
2023-08-03 21:13:20.868245004  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 497658 >= 497658
2023-08-03 21:13:20.868255103  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 595946 >= 595838
2023-08-03 21:13:20.868325055  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 621806 >= 621806
2023-08-03 21:13:20.868412504  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 718894 >= 718894
2023-08-03 21:13:20.868481778  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 720910 >= 720910
2023-08-03 21:13:20.868565758  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 749182 >= 749182
2023-08-03 21:13:20.868647998  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 762748 >= 762748
2023-08-03 21:13:20.868708397  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 882764 >= 882764
2023-08-03 21:13:20.868786361  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 915180 >= 915180
2023-08-03 21:13:20.868870066  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1041714 >= 1041714
2023-08-03 21:13:20.868953015  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1235912 >= 1235114
2023-08-03 21:13:20.869029300  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1261002 >= 1261002
2023-08-03 21:13:20.869109278  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1267354 >= 1267354
2023-08-03 21:13:20.869184275  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1394666 >= 1394500
2023-08-03 21:13:20.869258132  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1462564 >= 1462564
2023-08-03 21:13:20.869334463  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1648698 >= 1648698
2023-08-03 21:13:20.869411930  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1656986 >= 1656986
2023-08-03 21:13:20.869484882  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1781068 >= 1781068
2023-08-03 21:13:20.869559748  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1883864 >= 1883864
2023-08-03 21:13:20.869634701  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 2110116 >= 2110116
2023-08-03 21:13:20.869707238  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 2515882 >= 2515826
2023-08-03 21:13:20.869779096  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 2624898 >= 2624898
2023-08-03 21:13:20.869851405  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 2722716 >= 2722716
2023-08-03 21:13:20.869926587  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 3206282 >= 3206282
2023-08-03 21:13:20.870000269  [2023-08-03 21:13:20] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x555a677666c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 3429764 >= 3429764
2023-08-03 21:13:20.870083327  [2023-08-03 21:13:20] audio.frigate_backyard         INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:20.870177074  [2023-08-03 21:13:20] audio.frigate_backyard         INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:22.193851306  [2023-08-03 21:13:22] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:22.817006090  [2023-08-03 21:13:22] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:22.817261681  [2023-08-03 21:13:22] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:24.811314434  [2023-08-03 21:13:24] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:24.880294823  [2023-08-03 21:13:24] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55c206cdcb00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 7744 >= 7744
2023-08-03 21:13:24.880325265  [2023-08-03 21:13:24] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55c206cdcb00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 10944 >= 10944
2023-08-03 21:13:24.880419016  [2023-08-03 21:13:24] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55c206cdcb00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 12736 >= 12736
2023-08-03 21:13:24.880439177  [2023-08-03 21:13:24] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:24.880543628  [2023-08-03 21:13:24] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:25.763471742  [2023-08-03 21:13:25] audio.frigate_backyard         ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:26.846762035  [2023-08-03 21:13:26] audio.frigate_street_nw        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:32.204061793  [2023-08-03 21:13:32] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:32.204076259  [2023-08-03 21:13:32] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:34.184427422  [2023-08-03 21:13:34] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:34.820015743  [2023-08-03 21:13:34] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:34.820127278  [2023-08-03 21:13:34] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:35.772135469  [2023-08-03 21:13:35] audio.frigate_backyard         INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:35.772178773  [2023-08-03 21:13:35] audio.frigate_backyard         INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 21:13:36.833112299  [2023-08-03 21:13:36] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 21:13:36.855998769  [2023-08-03 21:13:36] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55bb77b5f880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 7440 >= 7440
2023-08-03 21:13:36.856065717  [2023-08-03 21:13:36] ffmpeg.frigate_street_nw.audio ERROR   : [s16le @ 0x55bb77b5f880] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 12640 >= 12640
2023-08-03 21:13:36.856122531  [2023-08-03 21:13:36] audio.frigate_street_nw        INFO    : Terminating the existing ffmpeg process...
2023-08-03 21:13:36.856179166  [2023-08-03 21:13:36] audio.frigate_street_nw        INFO    : Waiting for ffmpeg to exit gracefully...

Cameras show up in Home Assistant with the same black image as above.

Majestic7979 commented 1 year ago

I am also unable to use ONVIF in the birdseye, and nothing shows in the birdseye because the cams aren't coming up:

2023-08-03 21:09:18.449773610  [INFO] Preparing Frigate...
2023-08-03 21:09:18.458807797  [INFO] Starting Frigate...
2023-08-03 21:09:19.161825196  [2023-08-03 21:09:19] frigate.app                    INFO    : Starting Frigate (0.13.0-f8c0f74)
2023-08-03 21:09:19.447176998  [2023-08-03 21:09:19] peewee_migrate.logs            INFO    : Starting migrations
2023-08-03 21:09:19.449765755  [2023-08-03 21:09:19] peewee_migrate.logs            INFO    : There is nothing to migrate
2023-08-03 21:09:19.579086010  [2023-08-03 21:09:19] frigate.ptz.onvif              ERROR   : Onvif connection to frigate_street_se failed: Unknown error: The CapabilityCategory type doesn't accept collections as value
2023-08-03 21:09:19.614423962  [2023-08-03 21:09:19] frigate.ptz.onvif              ERROR   : Onvif connection to frigate_street_front failed: Unknown error: The CapabilityCategory type doesn't accept collections as value
2023-08-03 21:09:19.648416640  [2023-08-03 21:09:19] frigate.ptz.onvif              ERROR   : Onvif connection to frigate_street_nw failed: Unknown error: The CapabilityCategory type doesn't accept collections as value
2023-08-03 21:09:19.721035903  [2023-08-03 21:09:19] frigate.ptz.onvif              ERROR   : Onvif connection to frigate_backyard failed: Unknown error: The CapabilityCategory type doesn't accept collections as value
2023-08-03 21:09:19.724209414  [2023-08-03 21:09:19] frigate.app                    INFO    : Recording process started: 881
2023-08-03 21:09:19.725215860  [2023-08-03 21:09:19] frigate.app                    INFO    : go2rtc process pid: 98
2023-08-03 21:09:19.735093175  [2023-08-03 21:09:19] detector.tensorrt              INFO    : Starting detection process: 890
2023-08-03 21:09:19.784603105  [2023-08-03 21:09:19] frigate.app                    INFO    : Output process started: 892
2023-08-03 21:09:19.784743098  [2023-08-03 21:09:19] frigate.app                    INFO    : Camera processor started for frigate_street_se: 896
2023-08-03 21:09:19.784773267  [2023-08-03 21:09:19] frigate.app                    INFO    : Camera processor started for frigate_street_front: 898
2023-08-03 21:09:19.784797093  [2023-08-03 21:09:19] frigate.app                    INFO    : Camera processor started for frigate_street_nw: 901
2023-08-03 21:09:19.784825177  [2023-08-03 21:09:19] frigate.app                    INFO    : Camera processor started for frigate_backyard: 903
2023-08-03 21:09:19.784853646  [2023-08-03 21:09:19] frigate.app                    INFO    : Capture process started for frigate_street_se: 907
2023-08-03 21:09:19.784882641  [2023-08-03 21:09:19] frigate.app                    INFO    : Capture process started for frigate_street_front: 910
2023-08-03 21:09:19.784909548  [2023-08-03 21:09:19] frigate.app                    INFO    : Capture process started for frigate_street_nw: 914
2023-08-03 21:09:19.784936479  [2023-08-03 21:09:19] frigate.app                    INFO    : Capture process started for frigate_backyard: 920
2023-08-03 21:09:19.784967734  [2023-08-03 21:09:19] frigate.app                    INFO    : Audio process started: 925
2023-08-03 21:09:20.023333334  [2023-08-03 21:09:20] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 176 MiB
2023-08-03 21:09:20.236669760  [2023-08-03 21:09:20] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +193, GPU +74, now: CPU 687, GPU 500 (MiB)
2023-08-03 21:09:20.312095055  [2023-08-03 21:09:20] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +111, GPU +46, now: CPU 798, GPU 546 (MiB)
2023-08-03 21:09:20.319182772  [2023-08-03 21:09:20] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +176, now: CPU 0, GPU 176 (MiB)
2023-08-03 21:09:20.324935021  [2023-08-03 21:09:20] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 621, GPU 538 (MiB)
2023-08-03 21:09:20.325570102  [2023-08-03 21:09:20] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 621, GPU 546 (MiB)
2023-08-03 21:09:20.325625657  [2023-08-03 21:09:20] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +29, now: CPU 0, GPU 205 (MiB)
2023-08-03 21:09:20.325666330  [2023-08-03 21:09:20] frigate.detectors.plugins.tensorrt WARNING : CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See `CUDA_MODULE_LOADING` in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
2023-08-03 21:09:21.502951336  Process camera_processor:frigate_street_se:
Majestic7979 commented 1 year ago

The video is definitely being recorded, because I just heard an ambulance followed by a car alarm, went to the recordings UI for my backyard camera and it was exactly the same sound. Video was playing. I simply don't get any cameras in HA and the camera video does not show up in Frigate. I do not have go2rtc in my config.

Majestic7979 commented 1 year ago

The problem with go2rtc in my case is that I want to decouple the camera streams from Frigate, so that if I have to go fix something and Frigate is offline I will still have a stream running. That is how I was lucky to catch a burglar last week, I kept VLC running with the source from mediamtx.

Since mediamtx and go2rtc share ports, either one or the other won't launch in docker because of port conflicts.

So you can see I tried to get around this by mapping my frigate docker CLI ports as such: -p 5000:5000 -p 8551:8554 -p 1988:1984 -p 8552:8555

But I don't know if it breaks stuff.

NickM-27 commented 1 year ago

Hmm, that is confusing because the record and detect will be done on the same ffmpeg process so if one is working they both should be.

I would suggest disabling audio detection and onvif for now and see how it fairs

Majestic7979 commented 1 year ago

Wwelcome to my world. If it confuses you who's directly involved imagine myself. I disabled onvif and audio and it's still not working. To avoid any ambiguity, here's the latest config:

####################################
########## FRIGATE CONFIG ##########

mqtt:
  enabled: false

detectors:
  tensorrt:
    type: tensorrt
    device: 0

model:
  path: /config/model_cache/tensorrt/yolov7-320.trt
  input_tensor: nchw
  input_pixel_format: rgb
  width: 320
  height: 320

ui:
  live_mode: jsmpeg
  timezone: Europe/London
  use_experimental: False
  time_format: 12hour
  date_style: short
  time_style: medium
  strftime_fmt: "%Y/%m/%d %H:%M"

logger:
  default: info
  logs:
    frigate.event: info
#    frigate.record: debug

database:
  path: /db/frigate.db

birdseye:
  enabled: True
  restream: True
  width: 1280
  height: 960
    # 1 is the highest quality, and 31 is the lowest. Lower quality feeds utilize less CPU resources.
  quality: 10
  mode: continuous

detect:
  width: 1280
  height: 960
  fps: 5
  enabled: true
  max_disappeared: 60

#audio:
#  enabled: True
#  max_not_heard: 30
#  min_volume: 500
#  listen:
#    - bark
#    - scream
#    - yell
#    - speech
#  filters:
#    speech:
#      threshold: 0.8

objects:
  track:
    - person

record:
  enabled: True
  retain:
    days: 15
    mode: all
  events:
    retain:
      default: 15

snapshots:
  enabled: True
  timestamp: True
  bounding_box: False
  crop: False
  retain:
    default: 15

rtmp:
  enabled: False

timestamp_style:
    # "tl" (top left), "tr" (top right), "bl" (bottom left), "br" (bottom right)
  position: "tl"
    # Optional: Format specifier conform to the Python package "datetime" (default: shown below)
    #           Additional Examples:
    #             german: "%d.%m.%Y %H:%M:%S"
  format: "%m/%d/%Y %H:%M:%S"
  color:
    red: 255
    green: 255
    blue: 255
  thickness: 2
    # None (No effect),
    # "solid" (solid background in inverse color of font)
    # "shadow" (shadow for font)
  effect: shadow

telemetry:
  network_interfaces:
    - eth
    - enp
    - eno
    - ens
    - wl
    - lo
  stats:
    intel_gpu_stats: True
    network_bandwidth: True
  version_check: True

###################################
########## CAMERA CONFIG ##########

cameras:

  frigate_street_se:
    #onvif:
    #  host: x.x.x.a
    #  port: 8091
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/se
          input_args: preset-rtsp-generic
          roles:
            - record
            #- audio
            - detect
    detect:
      enabled: true

  frigate_street_front:
    #onvif:
    #  host: x.x.x.b
    #  port: 8091
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/front
          input_args: preset-rtsp-generic
          roles:
            - record
            #- audio
            - detect
    detect:
      enabled: true

  frigate_street_nw:
    #onvif:
    #  host: x.x.x.c
    #  port: 8091
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/nw
          input_args: preset-rtsp-generic
          roles:
            - record
            #- audio
            - detect
    detect:
      enabled: true

  frigate_backyard:
    #onvif:
    #  host: x.x.x.d
    #  port: 8091
    enabled: True
    ffmpeg:
      hwaccel_args: preset-nvidia-h264
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://x.x.x.x:8554/backyard
          input_args: preset-rtsp-generic
          roles:
            - record
            #- audio
            - detect
    detect:
      enabled: true
Majestic7979 commented 1 year ago

And latest logs after docker restart frigate:

2023-08-03 21:26:42.728261443  [INFO] Preparing Frigate...
2023-08-03 21:26:42.733799919  [INFO] Starting Frigate...
2023-08-03 21:26:43.473369785  [2023-08-03 21:26:43] frigate.app                    INFO    : Starting Frigate (0.13.0-f8c0f74)
2023-08-03 21:26:43.763329792  [2023-08-03 21:26:43] peewee_migrate.logs            INFO    : Starting migrations
2023-08-03 21:26:43.800500985  [2023-08-03 21:26:43] peewee_migrate.logs            INFO    : There is nothing to migrate
2023-08-03 21:26:43.803362161  [2023-08-03 21:26:43] frigate.app                    INFO    : Recording process started: 878
2023-08-03 21:26:43.804344570  [2023-08-03 21:26:43] frigate.app                    INFO    : go2rtc process pid: 96
2023-08-03 21:26:43.814404959  [2023-08-03 21:26:43] detector.tensorrt              INFO    : Starting detection process: 887
2023-08-03 21:26:43.815695823  [2023-08-03 21:26:43] frigate.app                    INFO    : Output process started: 889
2023-08-03 21:26:43.820077935  [2023-08-03 21:26:43] frigate.app                    INFO    : Camera processor started for frigate_street_se: 893
2023-08-03 21:26:43.822657153  [2023-08-03 21:26:43] frigate.app                    INFO    : Camera processor started for frigate_street_front: 894
2023-08-03 21:26:43.825311612  [2023-08-03 21:26:43] frigate.app                    INFO    : Camera processor started for frigate_street_nw: 896
2023-08-03 21:26:43.828042800  [2023-08-03 21:26:43] frigate.app                    INFO    : Camera processor started for frigate_backyard: 898
2023-08-03 21:26:43.830612924  [2023-08-03 21:26:43] frigate.app                    INFO    : Capture process started for frigate_street_se: 900
2023-08-03 21:26:43.833233236  [2023-08-03 21:26:43] frigate.app                    INFO    : Capture process started for frigate_street_front: 904
2023-08-03 21:26:43.835738207  [2023-08-03 21:26:43] frigate.app                    INFO    : Capture process started for frigate_street_nw: 908
2023-08-03 21:26:43.838413986  [2023-08-03 21:26:43] frigate.app                    INFO    : Capture process started for frigate_backyard: 913
2023-08-03 21:26:44.103291368  [2023-08-03 21:26:44] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 176 MiB
2023-08-03 21:26:44.313305096  [2023-08-03 21:26:44] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +193, GPU +74, now: CPU 685, GPU 500 (MiB)
2023-08-03 21:26:44.384659605  [2023-08-03 21:26:44] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +110, GPU +46, now: CPU 795, GPU 546 (MiB)
2023-08-03 21:26:44.385714347  [2023-08-03 21:26:44] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +176, now: CPU 0, GPU 176 (MiB)
2023-08-03 21:26:44.391606986  [2023-08-03 21:26:44] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 619, GPU 538 (MiB)
2023-08-03 21:26:44.391654607  [2023-08-03 21:26:44] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 619, GPU 546 (MiB)
2023-08-03 21:26:44.391682403  [2023-08-03 21:26:44] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +29, now: CPU 0, GPU 205 (MiB)
2023-08-03 21:26:44.391707265  [2023-08-03 21:26:44] frigate.detectors.plugins.tensorrt WARNING : CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See `CUDA_MODULE_LOADING` in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
2023-08-03 21:26:45.437990191  Process camera_processor:frigate_backyard:
2023-08-03 21:26:45.438628497  Traceback (most recent call last):
2023-08-03 21:26:45.438644545    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2023-08-03 21:26:45.438645583      self.run()
2023-08-03 21:26:45.438646599    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2023-08-03 21:26:45.438647381      self._target(*self._args, **self._kwargs)
2023-08-03 21:26:45.438659164    File "/opt/frigate/frigate/video.py", line 506, in track_camera
2023-08-03 21:26:45.438660036      process_frames(
2023-08-03 21:26:45.438660896    File "/opt/frigate/frigate/video.py", line 881, in process_frames
2023-08-03 21:26:45.438661576      detect(
2023-08-03 21:26:45.438662397    File "/opt/frigate/frigate/video.py", line 580, in detect
2023-08-03 21:26:45.438663216      region_detections = object_detector.detect(tensor_input)
2023-08-03 21:26:45.438665660    File "/opt/frigate/frigate/object_detection.py", line 225, in detect
2023-08-03 21:26:45.438666756      (self.labels[int(d[0])], float(d[1]), (d[2], d[3], d[4], d[5]))
2023-08-03 21:26:45.438678685  KeyError: -11
2023-08-03 21:26:45.624280634  Process camera_processor:frigate_street_front:
2023-08-03 21:26:45.624672534  Traceback (most recent call last):
2023-08-03 21:26:45.624684985    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2023-08-03 21:26:45.624686046      self.run()
2023-08-03 21:26:45.624686930    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2023-08-03 21:26:45.624687693      self._target(*self._args, **self._kwargs)
2023-08-03 21:26:45.624688454    File "/opt/frigate/frigate/video.py", line 506, in track_camera
2023-08-03 21:26:45.624689091      process_frames(
2023-08-03 21:26:45.624693313    File "/opt/frigate/frigate/video.py", line 881, in process_frames
2023-08-03 21:26:45.624693933      detect(
2023-08-03 21:26:45.624694688    File "/opt/frigate/frigate/video.py", line 580, in detect
2023-08-03 21:26:45.624695439      region_detections = object_detector.detect(tensor_input)
2023-08-03 21:26:45.624696256    File "/opt/frigate/frigate/object_detection.py", line 225, in detect
2023-08-03 21:26:45.624697049      (self.labels[int(d[0])], float(d[1]), (d[2], d[3], d[4], d[5]))
2023-08-03 21:26:45.624697628  KeyError: -11
2023-08-03 21:26:45.632060537  Process camera_processor:frigate_street_se:
2023-08-03 21:26:45.632457203  Traceback (most recent call last):
2023-08-03 21:26:45.632467755    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2023-08-03 21:26:45.632468628      self.run()
2023-08-03 21:26:45.632469442    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2023-08-03 21:26:45.632470159      self._target(*self._args, **self._kwargs)
2023-08-03 21:26:45.632470884    File "/opt/frigate/frigate/video.py", line 506, in track_camera
2023-08-03 21:26:45.632471515      process_frames(
2023-08-03 21:26:45.632472264    File "/opt/frigate/frigate/video.py", line 881, in process_frames
2023-08-03 21:26:45.632472847      detect(
2023-08-03 21:26:45.632476554    File "/opt/frigate/frigate/video.py", line 580, in detect
2023-08-03 21:26:45.632477355      region_detections = object_detector.detect(tensor_input)
2023-08-03 21:26:45.632478161    File "/opt/frigate/frigate/object_detection.py", line 225, in detect
2023-08-03 21:26:45.632478903      (self.labels[int(d[0])], float(d[1]), (d[2], d[3], d[4], d[5]))
2023-08-03 21:26:45.632479499  KeyError: -6
2023-08-03 21:26:45.639611089  Process camera_processor:frigate_street_nw:
2023-08-03 21:26:45.639983439  Traceback (most recent call last):
2023-08-03 21:26:45.639994735    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2023-08-03 21:26:45.639995531      self.run()
2023-08-03 21:26:45.639996295    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2023-08-03 21:26:45.639996992      self._target(*self._args, **self._kwargs)
2023-08-03 21:26:45.639997715    File "/opt/frigate/frigate/video.py", line 506, in track_camera
2023-08-03 21:26:45.639998355      process_frames(
2023-08-03 21:26:45.640002264    File "/opt/frigate/frigate/video.py", line 881, in process_frames
2023-08-03 21:26:45.640002882      detect(
2023-08-03 21:26:45.640003639    File "/opt/frigate/frigate/video.py", line 580, in detect
2023-08-03 21:26:45.640004395      region_detections = object_detector.detect(tensor_input)
2023-08-03 21:26:45.640005189    File "/opt/frigate/frigate/object_detection.py", line 225, in detect
2023-08-03 21:26:45.640005941      (self.labels[int(d[0])], float(d[1]), (d[2], d[3], d[4], d[5]))
2023-08-03 21:26:45.640006521  KeyError: -13
NickM-27 commented 1 year ago

I missed it earlier but this confirms the issue, Frigate 0.13 requires nvidia driver 530+ for tensorrt, you are on 525 currently

Majestic7979 commented 1 year ago

I ran sudo apt update and it didn't provide any updates...

Majestic7979 commented 1 year ago 
sudo apt update
Hit:1 http://deb.debian.org/debian bookworm InRelease
Hit:2 http://deb.debian.org/debian bookworm-updates InRelease
Hit:3 https://downloads.plex.tv/repo/deb public InRelease
Hit:4 http://security.debian.org/debian-security bookworm-security InRelease
Hit:5 https://download.docker.com/linux/debian bullseye InRelease
Get:6 https://nvidia.github.io/libnvidia-container/experimental/debian10/amd64  InRelease [1,503 B]
Get:7 https://nvidia.github.io/libnvidia-container/stable/debian10/amd64  InRelease [1,484 B]
Ign:8 https://download.webmin.com/download/newkey/repository stable InRelease
Hit:9 https://download.webmin.com/download/newkey/repository stable Release
Fetched 2,987 B in 2s (1,987 B/s)
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
All packages are up to date.
NickM-27 commented 1 year ago

Another user that had the same thing: https://github.com/blakeblackshear/frigate/issues/7149#issuecomment-1642192271

The current production version of the driver is 535.86.05 which is what I run, not sure why the default apt repos don't have a newer version

Majestic7979 commented 1 year ago

My brain is absolutely melting at this point. I am severely sleep deprived and having anxiety through the roof. I don't think I can spend another hour researching how to get this driver up to date on Debian so if you want to tell me I will be very grateful, otherwise you're gonna soon watch a grown man weep.

NickM-27 commented 1 year ago

Looks like it just needs to use the nvidia installer, but I am not familiar with installing nvidia drivers on debian https://www.nvidia.com/Download/Find.aspx?lang=en-us

Majestic7979 commented 1 year ago

This is how:

https://distroid.net/clean-install-nvidia-drivers-on-debian-11/

I was able to complete it. I had to use Ctrl+Alt+F2 to enter TTY mode and then was able to logon as root and complete it. This is because at some point it was just hanging after CUPS service was loaded and would not go forward.

Now with the driver, I also had to update my nvidia container runtime: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html

After this, the cameras are showing successfully.

2023-08-03 22:12:49.343065935  [INFO] Preparing Frigate...
2023-08-03 22:12:49.395063535  [INFO] Starting Frigate...
2023-08-03 22:12:50.809315206  [2023-08-03 22:12:50] frigate.app                    INFO    : Starting Frigate (0.13.0-f8c0f74)
2023-08-03 22:12:52.919778608  [2023-08-03 22:12:52] peewee_migrate.logs            INFO    : Starting migrations
2023-08-03 22:12:53.053481092  [2023-08-03 22:12:53] peewee_migrate.logs            INFO    : There is nothing to migrate
2023-08-03 22:12:53.055933544  [2023-08-03 22:12:53] frigate.app                    INFO    : Recording process started: 881
2023-08-03 22:12:53.056979909  [2023-08-03 22:12:53] frigate.app                    INFO    : go2rtc process pid: 94
2023-08-03 22:12:53.065642936  [2023-08-03 22:12:53] detector.tensorrt              INFO    : Starting detection process: 890
2023-08-03 22:12:53.066408770  [2023-08-03 22:12:53] frigate.app                    INFO    : Output process started: 892
2023-08-03 22:12:53.069734613  [2023-08-03 22:12:53] frigate.app                    INFO    : Camera processor started for frigate_street_se: 896
2023-08-03 22:12:53.071998827  [2023-08-03 22:12:53] frigate.app                    INFO    : Camera processor started for frigate_street_front: 897
2023-08-03 22:12:53.074736458  [2023-08-03 22:12:53] frigate.app                    INFO    : Camera processor started for frigate_street_nw: 899
2023-08-03 22:12:53.077372983  [2023-08-03 22:12:53] frigate.app                    INFO    : Camera processor started for frigate_backyard: 901
2023-08-03 22:12:53.079840819  [2023-08-03 22:12:53] frigate.app                    INFO    : Capture process started for frigate_street_se: 904
2023-08-03 22:12:53.082410517  [2023-08-03 22:12:53] frigate.app                    INFO    : Capture process started for frigate_street_front: 908
2023-08-03 22:12:53.084604028  [2023-08-03 22:12:53] frigate.app                    INFO    : Capture process started for frigate_street_nw: 912
2023-08-03 22:12:53.087116404  [2023-08-03 22:12:53] frigate.app                    INFO    : Capture process started for frigate_backyard: 917
2023-08-03 22:12:53.208875839  [2023-08-03 22:12:53] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 176 MiB
2023-08-03 22:12:53.320397487  [2023-08-03 22:12:53] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +6, GPU +8, now: CPU 301, GPU 338 (MiB)
2023-08-03 22:12:53.324745639  [2023-08-03 22:12:53] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +1, GPU +10, now: CPU 302, GPU 348 (MiB)
2023-08-03 22:12:53.327559760  [2023-08-03 22:12:53] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +176, now: CPU 0, GPU 176 (MiB)
2023-08-03 22:12:53.351159052  [2023-08-03 22:12:53] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 126, GPU 340 (MiB)
2023-08-03 22:12:53.352114937  [2023-08-03 22:12:53] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 126, GPU 348 (MiB)
2023-08-03 22:12:53.352183751  [2023-08-03 22:12:53] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +29, now: CPU 0, GPU 205 (MiB)

I re-enabled audio in general config, and for each camera.

Finally, I enabled onvif...

2023-08-03 22:17:48.464091202  [2023-08-03 22:17:48] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 176 MiB
2023-08-03 22:17:48.541576751  [2023-08-03 22:17:48] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +6, GPU +8, now: CPU 303, GPU 340 (MiB)
2023-08-03 22:17:48.544073463  [2023-08-03 22:17:48] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +2, GPU +10, now: CPU 305, GPU 350 (MiB)
2023-08-03 22:17:48.550724272  [2023-08-03 22:17:48] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +176, now: CPU 0, GPU 176 (MiB)
2023-08-03 22:17:48.551383305  [2023-08-03 22:17:48] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 128, GPU 342 (MiB)
2023-08-03 22:17:48.551424339  [2023-08-03 22:17:48] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 128, GPU 350 (MiB)
2023-08-03 22:17:48.551470255  [2023-08-03 22:17:48] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +29, now: CPU 0, GPU 205 (MiB)
2023-08-03 22:17:51.319003001  [2023-08-03 22:17:51] audio.frigate_backyard         ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 22:18:01.328908826  [2023-08-03 22:18:01] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5616f5c761c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 37040 >= 37040
2023-08-03 22:18:01.328954403  [2023-08-03 22:18:01] audio.frigate_backyard         INFO    : Terminating the existing ffmpeg process...
2023-08-03 22:18:01.329017031  [2023-08-03 22:18:01] audio.frigate_backyard         INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 22:18:04.487010652  [2023-08-03 22:18:04] audio.frigate_backyard         ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 22:18:13.903840011  [2023-08-03 22:18:13] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_nw
2023-08-03 22:18:13.904261351  [2023-08-03 22:18:13] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_backyard
2023-08-03 22:18:13.905434608  [2023-08-03 22:18:13] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_se
2023-08-03 22:18:13.905753391  [2023-08-03 22:18:13] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_front
2023-08-03 22:18:14.496899405  [2023-08-03 22:18:14] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5635e69f71c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 23184 >= 23184
2023-08-03 22:18:14.496914208  [2023-08-03 22:18:14] audio.frigate_backyard         INFO    : Terminating the existing ffmpeg process...
2023-08-03 22:18:14.496954920  [2023-08-03 22:18:14] audio.frigate_backyard         INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-03 22:19:14.316509400  [2023-08-03 22:19:14] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_backyard
2023-08-03 22:19:14.319561719  [2023-08-03 22:19:14] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_nw
2023-08-03 22:19:14.320641607  [2023-08-03 22:19:14] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_se
2023-08-03 22:19:14.326171370  [2023-08-03 22:19:14] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_front
2023-08-03 22:19:27.022526890  [2023-08-03 22:19:27] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_nw
2023-08-03 22:19:27.023615833  [2023-08-03 22:19:27] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_backyard
2023-08-03 22:19:27.026448514  [2023-08-03 22:19:27] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_front
2023-08-03 22:19:27.026672440  [2023-08-03 22:19:27] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_se
2023-08-03 22:19:33.203547557  [2023-08-03 22:19:33] audio.frigate_backyard         ERROR   : Error reading audio data from ffmpeg process, restarting...
2023-08-03 22:19:43.214166879  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 22528 >= 22528
2023-08-03 22:19:43.214200093  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 37200 >= 37200
2023-08-03 22:19:43.214220808  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 73472 >= 73472
2023-08-03 22:19:43.214238920  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 79040 >= 79040
2023-08-03 22:19:43.214254503  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 99264 >= 99264
2023-08-03 22:19:43.214271678  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 112304 >= 112304
2023-08-03 22:19:43.214287272  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 135776 >= 135776
2023-08-03 22:19:43.214301890  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 137456 >= 137388
2023-08-03 22:19:43.214316421  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 165116 >= 165116
2023-08-03 22:19:43.214329451  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 174060 >= 174060
2023-08-03 22:19:43.214352780  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 232508 >= 232508
2023-08-03 22:19:43.214362889  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 234764 >= 234764
2023-08-03 22:19:43.214377101  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 347726 >= 347726
2023-08-03 22:19:43.214393776  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 387534 >= 387534
2023-08-03 22:19:43.214403331  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 425054 >= 425054
2023-08-03 22:19:43.214416404  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 447550 >= 447550
2023-08-03 22:19:43.214430169  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 478616 >= 478616
2023-08-03 22:19:43.214443415  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 481992 >= 481992
2023-08-03 22:19:43.214459800  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 489448 >= 489448
2023-08-03 22:19:43.214470395  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 542696 >= 542696
2023-08-03 22:19:43.214517670  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 575848 >= 575848
2023-08-03 22:19:43.214519485  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 581080 >= 581080
2023-08-03 22:19:43.214522374  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 611928 >= 611928
2023-08-03 22:19:43.214542470  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 614248 >= 614248
2023-08-03 22:19:43.214543285  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 617448 >= 616730
2023-08-03 22:19:43.214552919  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 636746 >= 636746
2023-08-03 22:19:43.214562976  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 662602 >= 662602
2023-08-03 22:19:43.214575880  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 667690 >= 667690
2023-08-03 22:19:43.214589288  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 678458 >= 678458
2023-08-03 22:19:43.214602216  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 686730 >= 686730
2023-08-03 22:19:43.214615217  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 741962 >= 741962
2023-08-03 22:19:43.214629727  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 778460 >= 778460
2023-08-03 22:19:43.214643446  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 853180 >= 853180
2023-08-03 22:19:43.214656807  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 895788 >= 895788
2023-08-03 22:19:43.214669894  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 904284 >= 904284
2023-08-03 22:19:43.214687081  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 917212 >= 917212
2023-08-03 22:19:43.214701346  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 920332 >= 920332
2023-08-03 22:19:43.214711542  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 923084 >= 923084
2023-08-03 22:19:43.214724327  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 937228 >= 937122
2023-08-03 22:19:43.214737121  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 953074 >= 953074
2023-08-03 22:19:43.214750601  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 991906 >= 991906
2023-08-03 22:19:43.214765371  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1013842 >= 1013842
2023-08-03 22:19:43.214779248  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1019442 >= 1019442
2023-08-03 22:19:43.214792565  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1047074 >= 1047074
2023-08-03 22:19:43.214805488  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1050210 >= 1050210
2023-08-03 22:19:43.214818800  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1099220 >= 1099220
2023-08-03 22:19:43.214832183  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1104180 >= 1104180
2023-08-03 22:19:43.214845178  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1173940 >= 1173940
2023-08-03 22:19:43.214858872  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1188196 >= 1188196
2023-08-03 22:19:43.214872238  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1231700 >= 1231700
2023-08-03 22:19:43.214886197  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1235476 >= 1235476
2023-08-03 22:19:43.214899178  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1237268 >= 1237268
2023-08-03 22:19:43.214912138  [2023-08-03 22:19:43] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x5578db0cfe40] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1259886 >= 1259886
2023-08-03 22:19:43.214926661  [2023-08-03 22:19:43] audio.frigate_backyard         INFO    : Terminating the existing ffmpeg process...
2023-08-03 22:19:43.214942356  [2023-08-03 22:19:43] audio.frigate_backyard         INFO    : Waiting for ffmpeg to exit gracefully...

So audio recognition and ONVIF aren't working for me. Parking this for today. I am absolutely in need of a long bath.

Majestic7979 commented 1 year ago

By the way, I like where this is heading. It's responsive and I like the Exports UI. It would be great if the "timeline" you can open on the right hand side of the recordings view could be overhauled. Currently, if I want to browse by hours, I have to scroll A LOT because the events fill up with small thumbnails. If there was a way to have a timeline like Nest cameras with little dots representing events, hovering the mouse on each dot to show a thumbnail/gif with 5 seconds before and after the event, that would be so much better. Something that can be dragged around, zoomed in and out to control granularity would be amazing. Not doable for 0.13 is it?

Majestic7979 commented 1 year ago

By the way my ONVIF control config in the camera has these options - what is your implementation compatible with?

image image

NickM-27 commented 1 year ago

Glad that got that going.

For onvif I'd suggest double checking that is the correct port and making sure the user works, I found some cameras require the admin user for onvif. Might be good to have another application that can verify onvif is working with a given config.

As far as audio goes, it definitely looks like it does not like the audio that is coming through, potentially due to the weird issue seen previously with the cameras. Likely will need to enable more logging in that part of the code so it is more clear what exactly broke.

By the way, I like where this is heading. It's responsive and I like the Exports UI. It would be great if the "timeline" you can open on the right hand side of the recordings view could be overhauled. Currently, if I want to browse by hours, I have to scroll A LOT because the events fill up with small thumbnails. If there was a way to have a timeline like Nest cameras with little dots representing events, hovering the mouse on each dot to show a thumbnail/gif with 5 seconds before and after the event, that would be so much better. Something that can be dragged around, zoomed in and out to control granularity would be amazing. Not doable for 0.13 is it?

A lot of the pieces are already in place for this as it has been on the roadmap for a while now, more pieces were put in place in 0.13.

By the way my ONVIF control config in the camera has these options - what is your implementation compatible with?

I am not familiar with that, I will need to do some research and see

Majestic7979 commented 1 year ago

Glad that got that going.

For onvif I'd suggest double checking that is the correct port and making sure the user works, I found some cameras require the admin user for onvif. Might be good to have another application that can verify onvif is working with a given config.

As far as audio goes, it definitely looks like it does not like the audio that is coming through, potentially due to the weird issue seen previously with the cameras. Likely will need to enable more logging in that part of the code so it is more clear what exactly broke.

By the way, I like where this is heading. It's responsive and I like the Exports UI. It would be great if the "timeline" you can open on the right hand side of the recordings view could be overhauled. Currently, if I want to browse by hours, I have to scroll A LOT because the events fill up with small thumbnails. If there was a way to have a timeline like Nest cameras with little dots representing events, hovering the mouse on each dot to show a thumbnail/gif with 5 seconds before and after the event, that would be so much better. Something that can be dragged around, zoomed in and out to control granularity would be amazing. Not doable for 0.13 is it?

All of the pieces are already in place for this as it has been on the roadmap for a while now, more pieces were put in place in 0.13.

By the way my ONVIF control config in the camera has these options - what is your implementation compatible with?

I am not familiar with that, I will need to do some research and see

I know ONVIF control is working because I can zoom in and out. Focus is also controllable. My cam is not a PT. It has no PT, just Z. It's fixed with a motorized zoom autofocus lens.

It definitely works, even without authentication (I am using "Onvif Device Manager 2.2.250" from the net). Tested, the zoom works fine, no username or password needed (just as I've set up in my camera).

skrashevich commented 1 year ago

Likely will need to enable more logging in that part of the code so it is more clear what exactly broke.

can you add current camera audio bitrate (or any similar thingy) to "/api/stats" handler response? it will be very useful for debug

Majestic7979 commented 1 year ago

I'll keep this open for the audio and the onvif. You said you need to research. Let me know whatever you need once you're done.

NickM-27 commented 1 year ago

Okay can go ahead and use the latest version https://github.com/blakeblackshear/frigate/pkgs/container/frigate/115994058?tag=dev-318ae28 and enable debug logs for ptz

logger:
  default: info
  logs:
    frigate.ptz.onvif: debug

this should give useful info for what is going on for both issues

Majestic7979 commented 1 year ago

Okay can go ahead and use the latest version https://github.com/blakeblackshear/frigate/pkgs/container/frigate/115994058?tag=dev-318ae28 and enable debug logs for ptz

logger:
  default: info
  logs:
    frigate.ptz.onvif: debug

this should give useful info for what is going on for both issues

Does that tag include tensorrt? Remember I have NVIDIA GPU...

I found the correct tag. I'll enable logs and send some later. Lunch time here!

Majestic7979 commented 1 year ago 
2023-08-05 15:16:02.556404232  [INFO] Preparing Frigate...
2023-08-05 15:16:02.562613579  [INFO] Starting Frigate...
2023-08-05 15:16:03.300206397  [2023-08-05 15:16:03] frigate.app                    INFO    : Starting Frigate (0.13.0-318ae28)
2023-08-05 15:16:03.529737698  [2023-08-05 15:16:03] peewee_migrate.logs            INFO    : Starting migrations
2023-08-05 15:16:03.639771820  [2023-08-05 15:16:03] peewee_migrate.logs            INFO    : There is nothing to migrate
2023-08-05 15:16:03.688351698  [2023-08-05 15:16:03] frigate.ptz.onvif              ERROR   : Onvif connection to frigate_street_se failed: Unknown error: The CapabilityCategory type doesn't accept collections as value
2023-08-05 15:16:03.691336401  [2023-08-05 15:16:03] frigate.app                    INFO    : Recording process started: 879
2023-08-05 15:16:03.692310679  [2023-08-05 15:16:03] frigate.app                    INFO    : go2rtc process pid: 97
2023-08-05 15:16:03.702365734  [2023-08-05 15:16:03] detector.tensorrt              INFO    : Starting detection process: 888
2023-08-05 15:16:03.747003334  [2023-08-05 15:16:03] frigate.app                    INFO    : Output process started: 890
2023-08-05 15:16:03.747104131  [2023-08-05 15:16:03] frigate.app                    INFO    : Camera processor started for frigate_street_se: 894
2023-08-05 15:16:03.747122638  [2023-08-05 15:16:03] frigate.app                    INFO    : Camera processor started for frigate_street_front: 896
2023-08-05 15:16:03.747139399  [2023-08-05 15:16:03] frigate.app                    INFO    : Camera processor started for frigate_street_nw: 898
2023-08-05 15:16:03.747156297  [2023-08-05 15:16:03] frigate.app                    INFO    : Camera processor started for frigate_backyard: 901
2023-08-05 15:16:03.747172812  [2023-08-05 15:16:03] frigate.app                    INFO    : Capture process started for frigate_street_se: 904
2023-08-05 15:16:03.747196708  [2023-08-05 15:16:03] frigate.app                    INFO    : Capture process started for frigate_street_front: 908
2023-08-05 15:16:03.747206186  [2023-08-05 15:16:03] frigate.app                    INFO    : Capture process started for frigate_street_nw: 913
2023-08-05 15:16:03.747219661  [2023-08-05 15:16:03] frigate.app                    INFO    : Capture process started for frigate_backyard: 918
2023-08-05 15:16:03.747234133  [2023-08-05 15:16:03] frigate.app                    INFO    : Audio process started: 924
2023-08-05 15:16:03.853234229  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 176 MiB
2023-08-05 15:16:03.935088194  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +6, GPU +8, now: CPU 301, GPU 348 (MiB)
2023-08-05 15:16:03.937835445  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +2, GPU +10, now: CPU 303, GPU 358 (MiB)
2023-08-05 15:16:03.939214007  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +176, now: CPU 0, GPU 176 (MiB)
2023-08-05 15:16:03.946254035  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 126, GPU 350 (MiB)
2023-08-05 15:16:03.946855565  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 126, GPU 358 (MiB)
2023-08-05 15:16:03.946877098  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +29, now: CPU 0, GPU 205 (MiB)
2023-08-05 15:16:40.407967797  [2023-08-05 15:16:40] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_se

Not very verbose-y....

Majestic7979 commented 1 year ago

More:

2023-08-05 15:16:02.556404232  [INFO] Preparing Frigate...
2023-08-05 15:16:02.562613579  [INFO] Starting Frigate...
2023-08-05 15:16:03.300206397  [2023-08-05 15:16:03] frigate.app                    INFO    : Starting Frigate (0.13.0-318ae28)
2023-08-05 15:16:03.529737698  [2023-08-05 15:16:03] peewee_migrate.logs            INFO    : Starting migrations
2023-08-05 15:16:03.639771820  [2023-08-05 15:16:03] peewee_migrate.logs            INFO    : There is nothing to migrate
2023-08-05 15:16:03.688351698  [2023-08-05 15:16:03] frigate.ptz.onvif              ERROR   : Onvif connection to frigate_street_se failed: Unknown error: The CapabilityCategory type doesn't accept collections as value
2023-08-05 15:16:03.691336401  [2023-08-05 15:16:03] frigate.app                    INFO    : Recording process started: 879
2023-08-05 15:16:03.692310679  [2023-08-05 15:16:03] frigate.app                    INFO    : go2rtc process pid: 97
2023-08-05 15:16:03.702365734  [2023-08-05 15:16:03] detector.tensorrt              INFO    : Starting detection process: 888
2023-08-05 15:16:03.747003334  [2023-08-05 15:16:03] frigate.app                    INFO    : Output process started: 890
2023-08-05 15:16:03.747104131  [2023-08-05 15:16:03] frigate.app                    INFO    : Camera processor started for frigate_street_se: 894
2023-08-05 15:16:03.747122638  [2023-08-05 15:16:03] frigate.app                    INFO    : Camera processor started for frigate_street_front: 896
2023-08-05 15:16:03.747139399  [2023-08-05 15:16:03] frigate.app                    INFO    : Camera processor started for frigate_street_nw: 898
2023-08-05 15:16:03.747156297  [2023-08-05 15:16:03] frigate.app                    INFO    : Camera processor started for frigate_backyard: 901
2023-08-05 15:16:03.747172812  [2023-08-05 15:16:03] frigate.app                    INFO    : Capture process started for frigate_street_se: 904
2023-08-05 15:16:03.747196708  [2023-08-05 15:16:03] frigate.app                    INFO    : Capture process started for frigate_street_front: 908
2023-08-05 15:16:03.747206186  [2023-08-05 15:16:03] frigate.app                    INFO    : Capture process started for frigate_street_nw: 913
2023-08-05 15:16:03.747219661  [2023-08-05 15:16:03] frigate.app                    INFO    : Capture process started for frigate_backyard: 918
2023-08-05 15:16:03.747234133  [2023-08-05 15:16:03] frigate.app                    INFO    : Audio process started: 924
2023-08-05 15:16:03.853234229  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 176 MiB
2023-08-05 15:16:03.935088194  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +6, GPU +8, now: CPU 301, GPU 348 (MiB)
2023-08-05 15:16:03.937835445  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +2, GPU +10, now: CPU 303, GPU 358 (MiB)
2023-08-05 15:16:03.939214007  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +176, now: CPU 0, GPU 176 (MiB)
2023-08-05 15:16:03.946254035  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 126, GPU 350 (MiB)
2023-08-05 15:16:03.946855565  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 126, GPU 358 (MiB)
2023-08-05 15:16:03.946877098  [2023-08-05 15:16:03] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +29, now: CPU 0, GPU 205 (MiB)
2023-08-05 15:16:40.407967797  [2023-08-05 15:16:40] frigate.ptz.onvif              ERROR   : Onvif is not setup for frigate_street_se
2023-08-05 15:17:39.352066615  [2023-08-05 15:17:39] audio.frigate_street_front     ERROR   : Error reading audio data from ffmpeg process: 'AudioFilterConfig' object has no attribute 'get'
2023-08-05 15:17:40.266621105  [2023-08-05 15:17:40] audio.frigate_street_se        ERROR   : Error reading audio data from ffmpeg process: 'AudioFilterConfig' object has no attribute 'get'
2023-08-05 15:17:41.336555230  [2023-08-05 15:17:41] audio.frigate_backyard         ERROR   : Error reading audio data from ffmpeg process: 'AudioFilterConfig' object has no attribute 'get'
2023-08-05 15:17:49.360376980  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 15680 >= 15680
2023-08-05 15:17:49.360441232  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 78880 >= 78880
2023-08-05 15:17:49.360489125  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 145184 >= 145184
2023-08-05 15:17:49.360532967  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 208800 >= 208800
2023-08-05 15:17:49.360613260  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 334670 >= 334670
2023-08-05 15:17:49.360656252  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 721888 >= 721888
2023-08-05 15:17:49.360681439  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 787344 >= 787344
2023-08-05 15:17:49.360701636  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 920434 >= 920434
2023-08-05 15:17:49.360720532  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 952338 >= 952338
2023-08-05 15:17:49.360739168  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1174444 >= 1174444
2023-08-05 15:17:49.360763548  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1184588 >= 1184480
2023-08-05 15:17:49.360776762  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1206208 >= 1206208
2023-08-05 15:17:49.360790591  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1301168 >= 1301168
2023-08-05 15:17:49.360805597  [2023-08-05 15:17:49] ffmpeg.frigate_street_front.audio ERROR   : [s16le @ 0x55cead3ba600] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1303120 >= 1303120
2023-08-05 15:17:49.360827697  [2023-08-05 15:17:49] audio.frigate_street_front     INFO    : Terminating the existing ffmpeg process...
2023-08-05 15:17:49.360846132  [2023-08-05 15:17:49] audio.frigate_street_front     INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-05 15:17:50.275169605  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 104624 >= 104624
2023-08-05 15:17:50.275205258  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 564404 >= 564404
2023-08-05 15:17:50.275240273  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 665844 >= 665844
2023-08-05 15:17:50.275252502  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 877928 >= 877928
2023-08-05 15:17:50.275271706  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 957944 >= 957944
2023-08-05 15:17:50.275288588  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1156056 >= 1156056
2023-08-05 15:17:50.275303920  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1158568 >= 1158568
2023-08-05 15:17:50.275318009  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1190222 >= 1190222
2023-08-05 15:17:50.275332904  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1287422 >= 1287422
2023-08-05 15:17:50.275347269  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1318878 >= 1318878
2023-08-05 15:17:50.275360396  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1384304 >= 1384304
2023-08-05 15:17:50.275374052  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1416896 >= 1416896
2023-08-05 15:17:50.275387799  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1451488 >= 1451488
2023-08-05 15:17:50.275401523  [2023-08-05 15:17:50] ffmpeg.frigate_street_se.audio ERROR   : [s16le @ 0x55bf0637b1c0] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1517926 >= 1517926
2023-08-05 15:17:50.275417718  [2023-08-05 15:17:50] audio.frigate_street_se        INFO    : Terminating the existing ffmpeg process...
2023-08-05 15:17:50.275434083  [2023-08-05 15:17:50] audio.frigate_street_se        INFO    : Waiting for ffmpeg to exit gracefully...
2023-08-05 15:17:51.343750764  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 16384 >= 16384
2023-08-05 15:17:51.343788503  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 69888 >= 69888
2023-08-05 15:17:51.343810756  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 223472 >= 223462
2023-08-05 15:17:51.343831030  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 274038 >= 274038
2023-08-05 15:17:51.343847241  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 280390 >= 280390
2023-08-05 15:17:51.343863257  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 337990 >= 337990
2023-08-05 15:17:51.343931167  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 402012 >= 402012
2023-08-05 15:17:51.343934033  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 441836 >= 441836
2023-08-05 15:17:51.343938089  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 453292 >= 453292
2023-08-05 15:17:51.343954815  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 491692 >= 491692
2023-08-05 15:17:51.343967553  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 509740 >= 509740
2023-08-05 15:17:51.343972209  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 608136 >= 608136
2023-08-05 15:17:51.343988743  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 619992 >= 619992
2023-08-05 15:17:51.344003110  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 674968 >= 674968
2023-08-05 15:17:51.344015006  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 738854 >= 738854
2023-08-05 15:17:51.344040586  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 748358 >= 748358
2023-08-05 15:17:51.344056030  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 771878 >= 771878
2023-08-05 15:17:51.344069462  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 872416 >= 872416
2023-08-05 15:17:51.344081684  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 903136 >= 903136
2023-08-05 15:17:51.344095731  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 952688 >= 952688
2023-08-05 15:17:51.344108700  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 978288 >= 978288
2023-08-05 15:17:51.344122411  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 991184 >= 991184
2023-08-05 15:17:51.344137261  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1042414 >= 1042414
2023-08-05 15:17:51.344152345  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1055214 >= 1055214
2023-08-05 15:17:51.344166532  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1099790 >= 1099790
2023-08-05 15:17:51.344183950  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1134526 >= 1134526
2023-08-05 15:17:51.344192771  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1167998 >= 1167998
2023-08-05 15:17:51.344208649  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1208866 >= 1208866
2023-08-05 15:17:51.344221572  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1234546 >= 1234546
2023-08-05 15:17:51.344236852  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1260242 >= 1260242
2023-08-05 15:17:51.344249055  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1266690 >= 1266690
2023-08-05 15:17:51.344260616  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1439188 >= 1439188
2023-08-05 15:17:51.344275182  [2023-08-05 15:17:51] ffmpeg.frigate_backyard.audio  ERROR   : [s16le @ 0x55718fa12b00] Application provided invalid, non monotonically increasing dts to muxer in stream 0: 1559076 >= 1559076
2023-08-05 15:17:51.344290655  [2023-08-05 15:17:51] audio.frigate_backyard         INFO    : Terminating the existing ffmpeg process...
2023-08-05 15:17:51.344308009  [2023-08-05 15:17:51] audio.frigate_backyard         INFO    : Waiting for ffmpeg to exit gracefully...

If I use the Onvif Device Manager 2.2.250 it can control the zoom in the camera via ONVIF completely fine... no credentials required.

NickM-27 commented 1 year ago

If you remove 

filters:
    speech:
      threshold: 0.8

Audio should work, I'll need to see why that's causing problems

Majestic7979 commented 1 year ago

If you remove

filters:
    speech:
      threshold: 0.8

Audio should work, I'll need to see why that's causing problems

Correct it stops the audio errors.

Now onto ONVIF...

2023-08-05 18:07:40.071757435 [INFO] Preparing Frigate... 2023-08-05 18:07:40.097390679 [INFO] Starting Frigate... 2023-08-05 18:07:40.956318372 [2023-08-05 18:07:40] frigate.app INFO : Starting Frigate (0.13.0-318ae28) 2023-08-05 18:07:41.744389167 [2023-08-05 18:07:41] peewee_migrate.logs INFO : Starting migrations 2023-08-05 18:07:41.775954106 [2023-08-05 18:07:41] peewee_migrate.logs INFO : There is nothing to migrate 2023-08-05 18:07:41.912578130 [2023-08-05 18:07:41] frigate.ptz.onvif ERROR : Onvif connection to frigate_street_se failed: Unknown error: The CapabilityCategory type doesn't accept collections as value 2023-08-05 18:07:41.915075141 [2023-08-05 18:07:41] frigate.app INFO : Recording process started: 877 2023-08-05 18:07:41.916091062 [2023-08-05 18:07:41] frigate.app INFO : go2rtc process pid: 96 2023-08-05 18:07:41.925289696 [2023-08-05 18:07:41] detector.tensorrt INFO : Starting detection process: 886 2023-08-05 18:07:41.965039315 [2023-08-05 18:07:41] frigate.app INFO : Output process started: 888 2023-08-05 18:07:41.965115605 [2023-08-05 18:07:41] frigate.app INFO : Camera processor started for frigate_street_se: 892 2023-08-05 18:07:41.965163059 [2023-08-05 18:07:41] frigate.app INFO : Camera processor started for frigate_street_front: 894 2023-08-05 18:07:41.965179642 [2023-08-05 18:07:41] frigate.app INFO : Camera processor started for frigate_street_nw: 896 2023-08-05 18:07:41.965190783 [2023-08-05 18:07:41] frigate.app INFO : Camera processor started for frigate_backyard: 899 2023-08-05 18:07:41.965204987 [2023-08-05 18:07:41] frigate.app INFO : Capture process started for frigate_street_se: 902 2023-08-05 18:07:41.965219926 [2023-08-05 18:07:41] frigate.app INFO : Capture process started for frigate_street_front: 906 2023-08-05 18:07:41.965235203 [2023-08-05 18:07:41] frigate.app INFO : Capture process started for frigate_street_nw: 911 2023-08-05 18:07:41.965249935 [2023-08-05 18:07:41] frigate.app INFO : Capture process started for frigate_backyard: 915 2023-08-05 18:07:41.965269614 [2023-08-05 18:07:41] frigate.app INFO : Audio process started: 922 2023-08-05 18:07:42.074270698 [2023-08-05 18:07:42] frigate.detectors.plugins.tensorrt INFO : Loaded engine size: 176 MiB 2023-08-05 18:07:42.186435800 [2023-08-05 18:07:42] frigate.detectors.plugins.tensorrt INFO : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +6, GPU +8, now: CPU 301, GPU 348 (MiB) 2023-08-05 18:07:42.190447950 [2023-08-05 18:07:42] frigate.detectors.plugins.tensorrt INFO : [MemUsageChange] Init cuDNN: CPU +2, GPU +10, now: CPU 303, GPU 358 (MiB) 2023-08-05 18:07:42.199186980 [2023-08-05 18:07:42] frigate.detectors.plugins.tensorrt INFO : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +176, now: CPU 0, GPU 176 (MiB) 2023-08-05 18:07:42.223080531 [2023-08-05 18:07:42] frigate.detectors.plugins.tensorrt INFO : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 126, GPU 350 (MiB) 2023-08-05 18:07:42.224668911 [2023-08-05 18:07:42] frigate.detectors.plugins.tensorrt INFO : [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 126, GPU 358 (MiB) 2023-08-05 18:07:42.224695122 [2023-08-05 18:07:42] frigate.detectors.plugins.tensorrt INFO : [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +29, now: CPU 0, GPU 205 (MiB) 2023-08-05 18:08:10.552834665 [2023-08-05 18:08:10] frigate.ptz.onvif ERROR : Onvif is not setup for frigate_street_se

NickM-27 commented 1 year ago

Onvif connection to frigate_street_se failed: Unknown error: The CapabilityCategory type doesn't accept collections as value

Interesting, this means that it is failing on the initial connection to the camera because the camera is sending a different format of data. I'd suggest trying the different protocols in the PTZ Configuration settings and I'd be curious what the AZ config options look like.

https://github.com/blakeblackshear/frigate/blob/fbed3fbb8be52c079facc44d0f59d1da837b1f69/frigate/ptz/onvif.py#L43-L62

Most likely the Onvif Device Manager is just made to handle these deviations from the standard.

Also curious, do you use HomeAssistant?

Majestic7979 commented 1 year ago

I use Home Assistant. I will change the settings in the cam and see what happens now.

Majestic7979 commented 1 year ago

PS I do not understand an iota of code... not sure what the above means.

NickM-27 commented 1 year ago

PS I do not understand an iota of code... not sure what the above means.

No worries I'm leaving that for note taking not for you.

And since you use home assistant, if you were able to try the built in onvif integration that would be interesting to see if it works. They use a different variation of the dependency we use.

Majestic7979 commented 1 year ago

Home assistant it even finds them on the net, just like Onvif Device Manager:

image

image

image

No username or password required.

Majestic7979 commented 1 year ago

I tested the service ONVIF PTZ in Home Assistant and it can control the zoom as expected. So it's your implementation that's not handling it

NickM-27 commented 1 year ago

Thanks for the info, looks like the HomeAssistant onvif library requires python 3.10+ so at this time we will not be able to move to that dependency and it seems like some onvif implementations won't be supported for 0.13. Pinning this issue until the new dependency can be used and this issue is fixed.

Majestic7979 commented 1 year ago

Alrighty thanks NickM. Isn't it possible to compare? I'm happy to run tests if you tell me exactly what to do. Or do you prefer to use that time for something else and wait? I am only confirming, seems like you've made your decision already which is to wait...

NickM-27 commented 1 year ago

Alrighty thanks NickM. Isn't it possible to compare? I'm happy to run tests if you tell me exactly what to do. Or do you prefer to use that time for something else and wait? I am only confirming, seems like you've made your decision already which is to wait...

I'm not 100% sure what you mean by compare.

The problem with a newer version of python is that a lot of Frigate's dependencies (pycoral, pytensor, etc.) do not support python 3.10+ so there is not an easy way to quickly test if it works, most likely frigate with python 3.10 could not even be built in it's current state without lots of testing and changes

Majestic7979 commented 1 year ago

I meant if you guys were thinking about modifying the library you're using by forking it to widen the compatibility by comparing the existing functions to what the library being used by HA currently does, then adapting it to bridge the current gaps, I would be happy to test. Does that make sense? I don't mind if ONVIF does not work, honestly it's not my priority. Currently Frigate is doing what needs to be done which is reliably recording 24/7 footage with audio and that's what law enforcement cares about. As for me, sure I want every little thing in my camera to work but it's not essential for me to control the zoom. When it comes, it comes. And I'll be happy to test.