search

roflcoopter / viseron

Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.
MIT License
1.5k stars 154 forks source link

Viseron on jetson, Darknet not recognizing cuda (v3.0.0b6) #759

Open eldadh opened 1 month ago

eldadh commented 1 month ago

I ran the latest beta ( [v3.0.0b6]) however it doesn't seem to recognize cuda on jetson nano

[fix-attrs.d] applying ownership & permissions fixes... [fix-attrs.d] done. [cont-init.d] executing container initialization scripts... [cont-init.d] 10-adduser: executing... usermod: no changes **** UID/GID *** User uid: 1000 User gid: 1000 ** Done ** [cont-init.d] 10-adduser: exited 0. [cont-init.d] 20-gid-video-device: executing... [cont-init.d] 20-gid-video-device: exited 0. [cont-init.d] 30-edgetpu-permission: executing... ** Setting EdgeTPU permissions * Coral Vendor IDs: "1a6e" "18d1" No EdgeTPU USB device was found No EdgeTPU PCI device was found ** Done ** [cont-init.d] 30-edgetpu-permission: exited 0. [cont-init.d] 40-set-env-vars: executing... ** Checking for hardware acceleration platforms ** OpenCL cannot be used VA-API cannot be used CUDA is available! PostgreSQL major version: 10 PostgreSQL bin: /usr/lib/postgresql/10/bin * Done *** [cont-init.d] 40-set-env-vars: exited 0. [cont-init.d] 50-check-if-rpi: executing... ** Checking if we are running on an RPi ** Not running on any supported RPi * Done *** [cont-init.d] 50-check-if-rpi: exited 0. [cont-init.d] 55-check-if-jetson: executing... ** Checking if we are running on a Jetson Board ** Running on a Jetson Nano * Done *** [cont-init.d] 55-check-if-jetson: exited 0. [cont-init.d] 60-ffmpeg-path: executing... ** Getting FFmpeg path * FFmpeg path: /usr/bin/ffmpeg ***** Done ***** [cont-init.d] 60-ffmpeg-path: exited 0. [cont-init.d] 70-gstreamer-path: executing... * Getting GStreamer path * GStreamer path: /usr/bin/gst-launch-1.0 *** Done ***** [cont-init.d] 70-gstreamer-path: exited 0. [cont-init.d] 80-postgres: executing... * Preparing PostgreSQL * Database has already been initialized. ***** Done ***** [cont-init.d] 80-postgres: exited 0. [cont-init.d] done. [services.d] starting services [services.d] done. Starting PostgreSQL Server... /var/run/postgresql:5432 - no response Waiting for PostgreSQL Server to start... 2024-05-23 11:45:55.087 IDT [496] LOG: listening on IPv4 address "127.0.0.1", port 5432 2024-05-23 11:45:55.087 IDT [496] LOG: could not bind IPv6 address "::1": Cannot assign requested address 2024-05-23 11:45:55.087 IDT [496] HINT: Is another postmaster already running on port 5432? If not, wait a few seconds and retry. 2024-05-23 11:45:55.097 IDT [496] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" 2024-05-23 11:45:55.134 IDT [498] LOG: database system was interrupted; last known up at 2024-05-23 11:44:26 IDT 2024-05-23 11:45:55.189 IDT [498] LOG: database system was not properly shut down; automatic recovery in progress 2024-05-23 11:45:55.203 IDT [498] LOG: redo starts at 0/1694608 2024-05-23 11:45:55.203 IDT [498] LOG: invalid record length at 0/1694640: wanted 24, got 0 2024-05-23 11:45:55.203 IDT [498] LOG: redo done at 0/1694608 2024-05-23 11:45:55.253 IDT [496] LOG: database system is ready to accept connections /var/run/postgresql:5432 - accepting connections PostgreSQL Server has started! [2024-05-23 11:45:58] [INFO ] [viseron.core] - ------------------------------------------- [2024-05-23 11:45:58] [INFO ] [viseron.core] - Initializing Viseron 3.0.0b6 [2024-05-23 11:45:58] [INFO ] [viseron.components] - Setting up component logger [2024-05-23 11:45:58] [INFO ] [viseron.components] - Setup of component logger took 0.0 seconds [2024-05-23 11:45:58] [INFO ] [viseron.components] - Setting up component data_stream [2024-05-23 11:45:58] [DEBUG ] [viseron.components.data_stream] - ulimit -u output: unlimited [2024-05-23 11:45:58] [DEBUG ] [viseron.components.data_stream] - Max threads: 999999 [2024-05-23 11:45:58] [DEBUG ] [viseron.watchdog] - Registering <RestartableThread(data_stream, initial daemon)> in the watchdog [2024-05-23 11:45:58] [INFO ] [viseron.components] - Setup of component data_stream took 0.0 seconds [2024-05-23 11:45:58] [INFO ] [viseron.components] - Setting up component storage [2024-05-23 11:45:59] [INFO ] [alembic.runtime.migration] - Context impl PostgresqlImpl. [2024-05-23 11:45:59] [INFO ] [alembic.runtime.migration] - Will assume transactional DDL. [2024-05-23 11:45:59] [DEBUG ] [viseron.components.storage] - Current database revision: 5f972755b320 [2024-05-23 11:45:59] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic event/domain/registered/camera, <bound method Storage._camera_registered of <viseron.components.storage.Storage object at 0x7f432c1f60>> [2024-05-23 11:45:59] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic viseron/signal/stopping, <bound method Storage._shutdown of <viseron.components.storage.Storage object at 0x7f432c1f60>> [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setup of component storage took 0.2 seconds [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setting up component webserver [2024-05-23 11:45:59] [DEBUG ] [asyncio] - Using selector: EpollSelector [2024-05-23 11:45:59] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic viseron/signal/shutdown, <bound method Webserver.stop of <Webserver(Tornado Webserver, initial daemon)>> [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setup of component webserver took 0.0 seconds [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setting up component ffmpeg [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setting up component darknet [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setting up component nvr [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setting up component mog2 [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setup of component nvr took 0.0 seconds [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setup of component ffmpeg took 0.0 seconds [2024-05-23 11:45:59] [INFO ] [viseron.components] - Setup of component mog2 took 0.0 seconds [2024-05-23 11:45:59] [DEBUG ] [viseron.components.darknet] - Using native Darknet [2024-05-23 11:45:59] [DEBUG ] [viseron.components.darknet] - Using weights /detectors/models/darknet/yolov7-tiny.weights and config /detectors/models/darknet/yolov7-tiny.cfg, 416x416 [2024-05-23 11:45:59] [DEBUG ] [viseron.components.darknet] - Creating Darknet data file /home/abc/darknet_data.data [2024-05-23 11:45:59] [DEBUG ] [viseron.watchdog] - Registering <RestartableThread(child_process.darknet.object_detector.input_thread, initial daemon)> in the watchdog [2024-05-23 11:45:59] [DEBUG ] [viseron.watchdog] - Registering <RestartableThread(child_process.darknet.object_detector.output_thread, initial daemon)> in the watchdog [2024-05-23 11:45:59] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic viseron/signal/shutdown, <bound method ChildProcessWorker.stop of <viseron.components.darknet.DarknetNative object at 0x7f40ff8700>> [2024-05-23 11:45:59] [DEBUG ] [viseron.components.darknet.libdarknet] - Try to load cfg: /detectors/models/darknet/yolov7-tiny.cfg, weights: /detectors/models/darknet/yolov7-tiny.weights, clear = 0 viseron: get_gpu_compute_capability: Unknown error 1080216688 [2024-05-23 11:45:59] [DEBUG ] [viseron.components.darknet.libdarknet] - CUDA status Error: file: ./src/dark_cuda.c: func: get_gpu_compute_capability() line: 607 [2024-05-23 11:45:59] [DEBUG ] [viseron.components.darknet.libdarknet] - [2024-05-23 11:45:59] [DEBUG ] [viseron.components.darknet.libdarknet] - CUDA Error: no CUDA-capable device is detected

roflcoopter commented 2 weeks ago

Interesting, is the issue still present on 3.0.0b7?

eldadh commented 1 week ago

unfortunatly yes ( i have tried both gstreamer configuration an ffmpeg) on jetson nano:

[s6-init] making user provided files available at /var/run/s6/etc...exited 0. [s6-init] ensuring user provided files have correct perms...exited 0. [fix-attrs.d] applying ownership & permissions fixes... [fix-attrs.d] done. [cont-init.d] executing container initialization scripts... [cont-init.d] 10-adduser: executing... usermod: no changes **** UID/GID *** User uid: 1000 User gid: 1000 ** Done ** [cont-init.d] 10-adduser: exited 0. [cont-init.d] 20-gid-video-device: executing... [cont-init.d] 20-gid-video-device: exited 0. [cont-init.d] 30-edgetpu-permission: executing... ** Setting EdgeTPU permissions * Coral Vendor IDs: "1a6e" "18d1" No EdgeTPU USB device was found No EdgeTPU PCI device was found ** Done ** [cont-init.d] 30-edgetpu-permission: exited 0. [cont-init.d] 40-set-env-vars: executing... ** Checking for hardware acceleration platforms ** OpenCL cannot be used VA-API cannot be used CUDA is available! PostgreSQL major version: 10 PostgreSQL bin: /usr/lib/postgresql/10/bin * Done *** [cont-init.d] 40-set-env-vars: exited 0. [cont-init.d] 50-check-if-rpi: executing... ** Checking if we are running on an RPi ** Not running on any supported RPi * Done *** [cont-init.d] 50-check-if-rpi: exited 0. [cont-init.d] 55-check-if-jetson: executing... ** Checking if we are running on a Jetson Board ** Running on a Jetson Nano * Done *** [cont-init.d] 55-check-if-jetson: exited 0. [cont-init.d] 60-ffmpeg-path: executing... ** Getting FFmpeg path * FFmpeg path: /usr/bin/ffmpeg ***** Done ***** [cont-init.d] 60-ffmpeg-path: exited 0. [cont-init.d] 70-gstreamer-path: executing... * Getting GStreamer path * GStreamer path: /usr/bin/gst-launch-1.0 *** Done ***** [cont-init.d] 70-gstreamer-path: exited 0. [cont-init.d] 80-postgres: executing... * Preparing PostgreSQL * Database has already been initialized. ***** Done *** [cont-init.d] 80-postgres: exited 0. [cont-init.d] done. [services.d] starting services [services.d] done. Starting PostgreSQL Server... /var/run/postgresql:5432 - no response Waiting for PostgreSQL Server to start... 2024-06-19 10:36:39.429 IDT [496] LOG: listening on IPv4 address "127.0.0.1", port 5432 2024-06-19 10:36:39.429 IDT [496] LOG: could not bind IPv6 address "::1": Cannot assign requested address 2024-06-19 10:36:39.429 IDT [496] HINT: Is another postmaster already running on port 5432? If not, wait a few seconds and retry. 2024-06-19 10:36:39.441 IDT [496] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" 2024-06-19 10:36:39.487 IDT [498] LOG: database system was interrupted; last known up at 2024-06-19 10:16:32 IDT 2024-06-19 10:36:39.546 IDT [498] LOG: database system was not properly shut down; automatic recovery in progress 2024-06-19 10:36:39.562 IDT [498] LOG: redo starts at 0/16B7928 2024-06-19 10:36:39.562 IDT [498] LOG: invalid record length at 0/16B7A08: wanted 24, got 0 2024-06-19 10:36:39.562 IDT [498] LOG: redo done at 0/16B79D0 2024-06-19 10:36:39.620 IDT [496] LOG: database system is ready to accept connections /var/run/postgresql:5432 - accepting connections PostgreSQL Server has started! [2024-06-19 10:36:44] [INFO ] [viseron.core] - ------------------------------------------- [2024-06-19 10:36:44] [INFO ] [viseron.core] - Initializing Viseron 3.0.0b7 [2024-06-19 10:36:44] [INFO ] [viseron.components] - Setting up component logger [2024-06-19 10:36:44] [INFO ] [viseron.components] - Setup of component logger took 0.0 seconds [2024-06-19 10:36:44] [INFO ] [viseron.components] - Setting up component data_stream [2024-06-19 10:36:44] [DEBUG ] [viseron.components.data_stream] - ulimit -u output: unlimited [2024-06-19 10:36:44] [DEBUG ] [viseron.components.data_stream] - Max threads: 999999 [2024-06-19 10:36:44] [DEBUG ] [viseron.watchdog] - Registering <RestartableThread(data_stream, initial daemon)> in the watchdog [2024-06-19 10:36:44] [INFO ] [viseron.components] - Setup of component data_stream took 0.0 seconds [2024-06-19 10:36:44] [INFO ] [viseron.components] - Setting up component webserver [2024-06-19 10:36:44] [DEBUG ] [asyncio] - Using selector: EpollSelector [2024-06-19 10:36:44] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic viseron/signal/shutdown, <bound method Webserver.stop of <Webserver(Tornado Webserver, initial daemon)>> [2024-06-19 10:36:44] [INFO ] [viseron.components] - Setup of component webserver took 0.0 seconds [2024-06-19 10:36:44] [INFO ] [viseron.components] - Setting up component storage [2024-06-19 10:36:45] [INFO ] [alembic.runtime.migration] - Context impl PostgresqlImpl. [2024-06-19 10:36:45] [INFO ] [alembic.runtime.migration] - Will assume transactional DDL. [2024-06-19 10:36:45] [DEBUG ] [viseron.components.storage] - Current database revision: 8462ca6851b2 [2024-06-19 10:36:45] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic event/domain/registered/camera, <bound method Storage._camera_registered of <viseron.components.storage.Storage object at 0x7f5b8cca60>> [2024-06-19 10:36:45] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic viseron/signal/stopping, <bound method Storage._shutdown of <viseron.components.storage.Storage object at 0x7f5b8cca60>> [2024-06-19 10:36:45] [INFO ] [viseron.components] - Setup of component storage took 0.4 seconds [2024-06-19 10:36:45] [INFO ] [viseron.components] - Setting up component darknet [2024-06-19 10:36:45] [INFO ] [viseron.components] - Setting up component gstreamer [2024-06-19 10:36:45] [INFO ] [viseron.components] - Setting up component mog2 [2024-06-19 10:36:45] [INFO ] [viseron.components] - Setting up component nvr [2024-06-19 10:36:45] [INFO ] [viseron.components] - Setup of component nvr took 0.0 seconds [2024-06-19 10:36:45] [INFO ] [viseron.components] - Setup of component mog2 took 0.0 seconds [2024-06-19 10:36:45] [DEBUG ] [viseron.components.darknet] - Using native Darknet [2024-06-19 10:36:45] [DEBUG ] [viseron.components.darknet] - Using weights /detectors/models/darknet/yolov7-tiny.weights and config /detectors/models/darknet/yolov7-tiny.cfg, 416x416 [2024-06-19 10:36:45] [DEBUG ] [viseron.components.darknet] - Creating Darknet data file /home/abc/darknet_data.data [2024-06-19 10:36:45] [DEBUG ] [viseron.watchdog] - Registering <RestartableThread(child_process.darknet.object_detector.input_thread, initial daemon)> in the watchdog [2024-06-19 10:36:45] [DEBUG ] [viseron.watchdog] - Registering <RestartableThread(child_process.darknet.object_detector.output_thread, initial daemon)> in the watchdog [2024-06-19 10:36:45] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic viseron/signal/shutdown, <bound method ChildProcessWorker.stop of <viseron.components.darknet.DarknetNative object at 0x7f43bf65f0>> [2024-06-19 10:36:45] [DEBUG ] [viseron.components.darknet.libdarknet] - Try to load cfg: /detectors/models/darknet/yolov7-tiny.cfg, weights: /detectors/models/darknet/yolov7-tiny.weights, clear = 0 viseron: get_gpu_compute_capability: Unknown error 526785648 [2024-06-19 10:36:45] [DEBUG ] [viseron.components.darknet.libdarknet] - CUDA status Error: file: ./src/dark_cuda.c: func: get_gpu_compute_capability() line: 607 [2024-06-19 10:36:45] [DEBUG ] [viseron.components.darknet.libdarknet] - [2024-06-19 10:36:45] [DEBUG ] [viseron.components.darknet.libdarknet] - CUDA Error: no CUDA-capable device is detected [2024-06-19 10:36:45] [INFO ] [viseron.components] - Setup of component gstreamer took 0.0 seconds [2024-06-19 10:36:49] [DEBUG ] [viseron.components.webserver.websocket_api] - WebSocket opened [2024-06-19 10:36:49] [DEBUG ] [viseron.components.webserver.websocket_api] - Received {"type":"subscribe_event","event":"domain/registered/camera","command_id":1} [2024-06-19 10:36:49] [DEBUG ] [viseron.components.webserver.websocket_api] - Received {"type":"subscribe_event","event":"domain/setup/domain_failed/camera/","command_id":2} [2024-06-19 10:36:49] [DEBUG ] [viseron.components.webserver.websocket_api] - Received {"type":"subscribe_event","event":"domain/setup/domain_loaded/camera/","command_id":3} [2024-06-19 10:36:49] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic event/domain/registered/camera, <function subscribe_event..forward_event at 0x7f41b49a20> [2024-06-19 10:36:49] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic event/domain/setup/domain_failed/camera/, <function subscribe_event..forward_event at 0x7f41b49b40> [2024-06-19 10:36:49] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic event/domain/setup/domain_loaded/camera/, <function subscribe_event..forward_event at 0x7f41b49c60> [2024-06-19 10:36:50] [DEBUG ] [viseron.components.webserver.api.handlers] - Routing to CamerasAPIHandler.get_cameras(*args=[], kwargs={}, request_arguments={}) [2024-06-19 10:36:50] [DEBUG ] [viseron.components.webserver.api.handlers] - Routing to CamerasAPIHandler.get_failed_cameras(*args=[], kwargs={}, request_arguments={}) [2024-06-19 10:37:00] [ERROR ] [viseron.components] - Component darknet is not ready. Retrying in 10 seconds in the background. Error: Failed to load Darknet network in child process [2024-06-19 10:37:00] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic viseron/signal/shutdown, <function Component.setup_component..cancel_retry_timer at 0x7f19da6830> [2024-06-19 10:37:00] [ERROR ] [viseron.components] - Setup of component darknet failed [2024-06-19 10:37:00] [ERROR ] [viseron.components] - Failed setup of component darknet [2024-06-19 10:37:01] [INFO ] [viseron.components] - Setting up domain camera for component gstreamer with identifier camera_1 [2024-06-19 10:37:01] [INFO ] [viseron.components] - Setting up domain motion_detector for component mog2 with identifier camera_1 [2024-06-19 10:37:01] [INFO ] [viseron.components] - Setting up domain nvr for component nvr with identifier camera_1 [2024-06-19 10:37:01] [DEBUG ] [viseron.components] - Domain nvr for component nvr with identifier camera_1 will wait for dependencies ['domain: camera, identifier: camera_1'] [2024-06-19 10:37:01] [DEBUG ] [viseron.components] - Domain nvr for component nvr with identifier camera_1 will wait for optional dependencies ['domain: motion_detector, identifier: camera_1'] [2024-06-19 10:37:01] [INFO ] [viseron.components] - Setting up domain camera for component gstreamer with identifier camera_2 [2024-06-19 10:37:01] [INFO ] [viseron.components] - Setting up domain motion_detector for component mog2 with identifier camera_2 [2024-06-19 10:37:01] [INFO ] [viseron.components] - Setting up domain nvr for component nvr with identifier camera_2 [2024-06-19 10:37:01] [DEBUG ] [viseron.components] - Domain nvr for component nvr with identifier camera_2 will wait for dependencies ['domain: camera, identifier: camera_2'] [2024-06-19 10:37:01] [DEBUG ] [viseron.components] - Domain nvr for component nvr with identifier camera_2 will wait for optional dependencies ['domain: motion_detector, identifier: camera_2'] [2024-06-19 10:37:01] [DEBUG ] [viseron.components] - Domain motion_detector for component mog2 with identifier camera_1 will wait for dependencies ['domain: camera, identifier: camera_1'] [2024-06-19 10:37:01] [DEBUG ] [viseron.components] - Domain motion_detector for component mog2 with identifier camera_2 will wait for dependencies ['domain: camera, identifier: camera_2'] [2024-06-19 10:37:01] [DEBUG ] [viseron.components.gstreamer.stream.camera_1] - Getting stream information for rtsp://192.168.3.110:8554/entrance?mp4 [2024-06-19 10:37:01] [DEBUG ] [viseron.components.ffmpeg.stream.camera_1] - FFprobe command: ffprobe -hide_banner -loglevel error -print_format json -show_error -show_entries stream=codec_type,codec_name,width,height,avg_frame_rate rtsp://192.168.3.110:8554/entrance?mp4 [2024-06-19 10:37:01] [DEBUG ] [viseron.components.gstreamer.stream.camera_2] - Getting stream information for rtsp://**:@192.168.3.83:554/av_stream/ch0 [2024-06-19 10:37:01] [DEBUG ] [viseron.components.ffmpeg.stream.camera_2] - FFprobe command: ffprobe -hide_banner -loglevel error -print_format json -show_error -show_entries stream=codec_type,codec_name,width,height,avg_frame_rate rtsp://:@192.168.3.83:554/av_stream/ch0 [2024-06-19 10:37:01] [ERROR ] [viseron.components.ffmpeg.stream.camera_2] - Error: Can't initialize nvrm channel [2024-06-19 10:37:01] [ERROR ] [viseron.components.ffmpeg.stream.camera_1] - Error: Can't initialize nvrm channel [2024-06-19 10:37:01] [ERROR ] [viseron.components.ffmpeg.stream.camera_2] - Error: Can't initialize nvrm channel [2024-06-19 10:37:01] [ERROR ] [viseron.components.ffmpeg.stream.camera_1] - Error: Can't initialize nvrm channel [2024-06-19 10:37:01] [ERROR ] [viseron.components.ffmpeg.stream.camera_2] - Couldn't create ddkvic Session: Cannot allocate memory [2024-06-19 10:37:01] [ERROR ] [viseron.components.ffmpeg.stream.camera_1] - Couldn't create ddkvic Session: Cannot allocate memory [2024-06-19 10:37:01] [ERROR ] [viseron.components] - Domain camera for component gstreamer is not ready. Retrying in 10 seconds. Error: FFprobe could not connect to stream. Output: b'nvbuf_utils [2024-06-19 10:37:01] [ERROR ] [viseron.components] - Domain camera for component gstreamer is not ready. Retrying in 10 seconds. Error: FFprobe could not connect to stream. Output: b'nvbuf_utils: Could not create Default NvBufferSession\n', message repeated 2 times [2024-06-19 10:37:01] [DEBUG ] [viseron.components.webserver.api.handlers] - Routing to CamerasAPIHandler.get_failed_cameras(*args=[], kwargs={}, request_arguments={}), message repeated 2 times [2024-06-19 10:37:10] [INFO ] [viseron.components] - Setting up component darknet, attempt 2 [2024-06-19 10:37:10] [DEBUG ] [viseron.components.darknet] - Using native Darknet [2024-06-19 10:37:10] [DEBUG ] [viseron.components.darknet] - Using weights /detectors/models/darknet/yolov7-tiny.weights and config /detectors/models/darknet/yolov7-tiny.cfg, 416x416 [2024-06-19 10:37:10] [DEBUG ] [viseron.components.darknet] - Creating Darknet data file /home/abc/darknet_data.data [2024-06-19 10:37:10] [DEBUG ] [viseron.watchdog] - Registering <RestartableThread(child_process.darknet.object_detector.input_thread, initial daemon)> in the watchdog [2024-06-19 10:37:10] [DEBUG ] [viseron.watchdog] - Registering <RestartableThread(child_process.darknet.object_detector.output_thread, initial daemon)> in the watchdog [2024-06-19 10:37:10] [DEBUG ] [viseron.components.data_stream] - Subscribing to data topic viseron/signal/shutdown, <bound method ChildProcessWorker.stop of <viseron.components.darknet.DarknetNative object at 0x7f19dc9000>> [2024-06-19 10:37:10] [DEBUG ] [viseron.components.darknet.libdarknet] - Try to load cfg: /detectors/models/darknet/yolov7-tiny.cfg, weights: /detectors/models/darknet/yolov7-tiny.weights, clear = 0 viseron: get_gpu_compute_capability: Unknown error 526785648 [2024-06-19 10:37:10] [DEBUG ] [viseron.components.darknet.libdarknet] - CUDA status Error: file: ./src/dark_cuda.c: func: get_gpu_compute_capability() line: 607 [2024-06-19 10:37:10] [DEBUG ] [viseron.components.darknet.libdarknet] - [2024-06-19 10:37:10] [DEBUG ] [viseron.components.darknet.libdarknet] - CUDA Error: no CUDA-capable device is detected [2024-06-19 10:37:11] [INFO ] [viseron.components] - Setting up domain camera for component gstreamer with identifier camera_2, attempt 2 [2024-06-19 10:37:11] [DEBUG ] [viseron.components.gstreamer.stream.camera_2] - Getting stream information for rtsp://**:@192.168.3.83:554/av_stream/ch0 [2024-06-19 10:37:11] [INFO ] [viseron.components] - Setting up domain camera for component gstreamer with identifier camera_1, attempt 2 [2024-06-19 10:37:11] [DEBUG ] [viseron.components.ffmpeg.stream.camera_2] - FFprobe command: ffprobe -hide_banner -loglevel error -print_format json -show_error -show_entries stream=codec_type,codec_name,width,height,avg_frame_rate rtsp://:@192.168.3.83:554/av_stream/ch0 [2024-06-19 10:37:11] [DEBUG ] [viseron.components.gstreamer.stream.camera_1] - Getting stream information for rtsp://192.168.3.110:8554/entrance?mp4 [2024-06-19 10:37:11] [DEBUG ] [viseron.components.ffmpeg.stream.camera_1] - FFprobe command: ffprobe -hide_banner -loglevel error -print_format json -show_error -show_entries stream=codec_type,codec_name,width,height,avg_frame_rate rtsp://192.168.3.110:8554/entrance?mp4 [2024-06-19 10:37:11] [ERROR ] [viseron.components.ffmpeg.stream.camera_2] - Error: Can't initialize nvrm channel, message repeated 2 times [2024-06-19 10:37:11] [ERROR ] [viseron.components.ffmpeg.stream.camera_2] - Couldn't create ddkvic Session: Cannot allocate memory [2024-06-19 10:37:11] [ERROR ] [viseron.components.ffmpeg.stream.camera_1] - Error: Can't initialize nvrm channel, message repeated 2 times [2024-06-19 10:37:11] [ERROR ] [viseron.components.ffmpeg.stream.camera_1] - Couldn't create ddkvic Session: Cannot allocate memory [2024-06-19 10:37:11] [ERROR ] [viseron.components] - Domain camera for component gstreamer is not ready. Retrying in 20 seconds. Error: FFprobe could not connect to stream. Output: b'nvbuf_utils [2024-06-19 10:37:11] [ERROR ] [viseron.components] - Domain camera for component gstreamer is not ready. Retrying in 20 seconds. Error: FFprobe could not connect to stream. Output: b'nvbuf_utils: Could not create Default NvBufferSession\n', message repeated 2 times [2024-06-19 10:37:11] [DEBUG ] [viseron.components.webserver.api.handlers] - Routing to CamerasAPIHandler.get_failed_cameras(*args=[], **kwargs={}, request_arguments={}), message repeated 2 times eldadh@jetson:~$

roflcoopter commented 1 week ago

Which Jetpack version are you running on? In v3 i have upgraded to 32.7.1, i am thinking there might be som driver compatibility issues at play

eldadh commented 1 week ago

root@jetson:/usr/local/mesh_services/meshagent# sudo apt-cache show nvidia-jetpack Package: nvidia-jetpack Version: 4.6.4-b39 Architecture: arm64 Maintainer: NVIDIA Corporation Installed-Size: 194 Depends: nvidia-l4t-jetson-multimedia-api (>> 32.7-0), nvidia-l4t-jetson-multimedia-api (<< 32.8-0), nvidia-cuda (= 4.6.4-b39), nvidia-tensorrt (= 4.6.4-b39), nvidia-nsight-sys (= 4.6.4-b39), nvidia-cudnn8 (= 4.6.4-b39), nvidia-opencv (= 4.6.4-b39), nvidia-container (= 4.6.4-b39), nvidia-visionworks (= 4.6.4-b39), nvidia-vpi (= 4.6.4-b39) Homepage: http://developer.nvidia.com/jetson Priority: standard Section: metapackages Filename: pool/main/n/nvidia-jetpack/nvidia-jetpack_4.6.4-b39_arm64.deb Size: 29388 SHA256: adf7a6660f73cdc4f95bc15c48d8588688e3afa5ee18bfd5b3a3caa3a458aa02 SHA1: 5abbe0df74f71579c1a0ee30ab7c2c236e1bcdbb MD5sum: ec293a56d17f2b2793448d621811330d Description: NVIDIA Jetpack Meta Package Description-md5: ad1462289bdbc54909ae109d1d32c0a8

Package: nvidia-jetpack Version: 4.6.3-b17 Architecture: arm64 Maintainer: NVIDIA Corporation Installed-Size: 194 Depends: nvidia-l4t-jetson-multimedia-api (>> 32.7-0), nvidia-l4t-jetson-multimedia-api (<< 32.8-0), nvidia-cuda (= 4.6.3-b17), nvidia-tensorrt (= 4.6.3-b17), nvidia-nsight-sys (= 4.6.3-b17), nvidia-cudnn8 (= 4.6.3-b17), nvidia-opencv (= 4.6.3-b17), nvidia-container (= 4.6.3-b17), nvidia-vpi (= 4.6.3-b17) Homepage: http://developer.nvidia.com/jetson Priority: standard Section: metapackages Filename: pool/main/n/nvidia-jetpack/nvidia-jetpack_4.6.3-b17_arm64.deb Size: 29368 SHA256: 694254a8667ebbf13852548bdd13a5b8ae61481ac059845b706398eefdcb9e01 SHA1: 67140fc8463ec61fd69352b225244b639c799edd MD5sum: afa1382b6caded6b736d494fc481bab4 Description: NVIDIA Jetpack Meta Package Description-md5: ad1462289bdbc54909ae109d1d32c0a8

Package: nvidia-jetpack Version: 4.6.2-b5 Architecture: arm64 Maintainer: NVIDIA Corporation Installed-Size: 194 Depends: nvidia-cuda (= 4.6.2-b5), nvidia-opencv (= 4.6.2-b5), nvidia-cudnn8 (= 4.6.2-b5), nvidia-tensorrt (= 4.6.2-b5), nvidia-visionworks (= 4.6.2-b5), nvidia-container (= 4.6.2-b5), nvidia-vpi (= 4.6.2-b5), nvidia-l4t-jetson-multimedia-api (>> 32.7-0), nvidia-l4t-jetson-multimedia-api (<< 32.8-0) Homepage: http://developer.nvidia.com/jetson Priority: standard Section: metapackages Filename: pool/main/n/nvidia-jetpack/nvidia-jetpack_4.6.2-b5_arm64.deb Size: 29378 SHA256: 925f4abff97e6024d86cff3b9e132e7c7554d05fb83590487381b7e925d5b2bb SHA1: e3ef727e87df5c331aece34508c110d57d744fe9 MD5sum: 7cb2e387af41bc8143ac7b6525af7794 Description: NVIDIA Jetpack Meta Package Description-md5: ad1462289bdbc54909ae109d1d32c0a8

Package: nvidia-jetpack Version: 4.6.1-b110 Architecture: arm64 Maintainer: NVIDIA Corporation Installed-Size: 194 Depends: nvidia-cuda (= 4.6.1-b110), nvidia-opencv (= 4.6.1-b110), nvidia-cudnn8 (= 4.6.1-b110), nvidia-tensorrt (= 4.6.1-b110), nvidia-visionworks (= 4.6.1-b110), nvidia-container (= 4.6.1-b110), nvidia-vpi (= 4.6.1-b110), nvidia-l4t-jetson-multimedia-api (>> 32.7-0), nvidia-l4t-jetson-multimedia-api (<< 32.8-0) Homepage: http://developer.nvidia.com/jetson Priority: standard Section: metapackages Filename: pool/main/n/nvidia-jetpack/nvidia-jetpack_4.6.1-b110_arm64.deb Size: 29366 SHA256: acfd9e75af780eab165361d61de4b4fe4974890864fe191060b402ac4c2f54d5 SHA1: a016568ac53705acc145a9f7e60505707bea259f MD5sum: 79be976b184a8c885bd9169ea5b7fb7b Description: NVIDIA Jetpack Meta Package Description-md5: ad1462289bdbc54909ae109d1d32c0a8

roflcoopter commented 1 week ago

What is t he output of dpkg-query --show nvidia-l4t-core?

eldadh commented 1 week ago

eldadh@jetson:~$ dpkg-query --show nvidia-l4t-core nvidia-l4t-core 32.7.4-20230608212426

roflcoopter commented 1 week ago

Hmm, seems to match whats inside the container...

Does the docker tag 3.0.0b3 work? That version still used L4T 32.6.1

You might get some database version issues so its best to start fresh by either deleting the postgresql folder in the config or just create a new temporary config folder for Viseron and mount that in the container

eldadh commented 1 week ago

in b3 version, there was SQL issues:

eldadh@jetson:~$ sudo docker logs viseron [s6-init] making user provided files available at /var/run/s6/etc...exited 0. [s6-init] ensuring user provided files have correct perms...exited 0. [fix-attrs.d] applying ownership & permissions fixes... [fix-attrs.d] done. [cont-init.d] executing container initialization scripts... [cont-init.d] 10-adduser: executing... **** UID/GID *** User uid: 1000 User gid: 1000 ** Done ** [cont-init.d] 10-adduser: exited 0. [cont-init.d] 20-gid-video-device: executing... [cont-init.d] 20-gid-video-device: exited 0. [cont-init.d] 30-edgetpu-permission: executing... ** Setting EdgeTPU permissions * Coral Vendor IDs: "1a6e" "18d1" No EdgeTPU USB device was found No EdgeTPU PCI device was found ** Done ** [cont-init.d] 30-edgetpu-permission: exited 0. [cont-init.d] 40-set-env-vars: executing... ** Checking for hardware acceleration platforms ** OpenCL cannot be used VA-API cannot be used CUDA is available! * Done *** [cont-init.d] 40-set-env-vars: exited 0. [cont-init.d] 50-check-if-rpi: executing... ** Checking if we are running on an RPi ** Not running on any supported RPi * Done *** [cont-init.d] 50-check-if-rpi: exited 0. [cont-init.d] 55-check-if-jetson: executing... ** Checking if we are running on a Jetson Board ** Running on a Jetson Nano * Done *** [cont-init.d] 55-check-if-jetson: exited 0. [cont-init.d] 60-ffmpeg-path: executing... ** Getting FFmpeg path * FFmpeg path: /usr/bin/ffmpeg ***** Done ***** [cont-init.d] 60-ffmpeg-path: exited 0. [cont-init.d] 70-gstreamer-path: executing... * Getting GStreamer path * GStreamer path: /usr/bin/gst-launch-1.0 *** Done ***** [cont-init.d] 70-gstreamer-path: exited 0. [cont-init.d] 80-postgres: executing... * Preparing PostgreSQL * Database has already been initialized. ***** Done ***** [cont-init.d] 80-postgres: exited 0. [cont-init.d] done. [services.d] starting services Starting PostgreSQL Server... s6-applyuidgid: fatal: unable to exec /usr/lib/postgresql/12/bin/postgres: No such file or directory

roflcoopter commented 1 week ago

Right, forgot about that. Will revert to 32.6.1 and see if that helps. Takes a while to rebuild all the containers tho

roflcoopter commented 1 day ago

3.0.0b8 is built on 32.6.1. Can you try it and see if you still have problems?