insight-platform / Savant

Python Computer Vision & Video Analytics Framework With Batteries Included
https://savant-ai.io
Apache License 2.0
568 stars 46 forks source link

Error when run command ./scripts/run_module.py #769

Closed chanwitkepha closed 5 months ago

chanwitkepha commented 5 months ago

My PC Machine

CPU: Intel Core i7 i7-7700 CPU @ 3.60GHz RAM: 64 GB GPU: NVidia 1080GTX x 2 OS: Ubuntu Server 20.04.6 LTS CUDA: 12.4

This is result fromnvidia-smi command

Wed Jun  5 11:56:37 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.54.15              Driver Version: 550.54.15      CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce GTX 1080        Off |   00000000:01:00.0 Off |                  N/A |
| 24%   42C    P8              8W /  200W |    1715MiB /   8192MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA GeForce GTX 1080        Off |   00000000:02:00.0 Off |                  N/A |
|  0%   42C    P8              8W /  200W |    3477MiB /   8192MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

I test LPR from this sample https://github.com/insight-platform/Savant/tree/develop/samples/license_plate_recognition

Result from /utils/check-environment-compatible

image

But when I run command ./scripts/run_module.py --build-engines samples/license_plate_recognition/module.yml

It shows error result, please suggest how to resolve this error about GStreamer, Thank you.

(Because after this result when I ran command docker compose -f samples/license_plate_recognition/docker-compose.x86.yml up, I cannot access to RTSP Server rtsp://127.0.0.1:554/stream/video)

INFO  insight::savant::engine_builder > Starting the module engine builder. Packages version info: Savant 0.4.1, Savant RS 0.2.29, DeepStream 6.4.
 INFO  insight::savant::config::module_config > Configuring module "license_plate_recognition"...
 INFO  insight::savant::config::module_config > Getting schema/configurator for zeromq_source_bin
 INFO  insight::savant::config::module_config > Getting schema/configurator for zeromq_sink
 INFO  insight::savant::config::module_config > Getting schema/configurator for nvinfer
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=yolov8n): Path to the model files has been set to "/cache/models/license_plate_recognition/yolov8n".
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=yolov8n): Model engine file has been set to "yolov8n.onnx_b1_gpu0_fp16.engine".
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=yolov8n): Model output converter will be used.
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=yolov8n): Resulting configuration file "/cache/models/license_plate_recognition/yolov8n/yolov8n_config_savant.txt" has been saved.
 INFO  insight::savant::config::module_config               > Getting schema/configurator for nvinfer
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=LPDNet): Path to the model files has been set to "/cache/models/license_plate_recognition/LPDNet".
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=LPDNet): Model engine file has been set to "LPDNet_usa_pruned_tao5.onnx_b16_gpu0_int8.engine".
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=LPDNet): Resulting configuration file "/cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5_config_savant.txt" has been saved.
 INFO  insight::savant::config::module_config               > Getting schema/configurator for nvtracker
 INFO  insight::savant::config::module_config               > Getting schema/configurator for nvinfer
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@classifier:v1(name=LPRNet): Path to the model files has been set to "/cache/models/license_plate_recognition/LPRNet".
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@classifier:v1(name=LPRNet): Model engine file has been set to "us_lprnet_baseline18_deployable.etlt_b16_gpu0_fp16.engine".
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@classifier:v1(name=LPRNet): Model output converter will be used.
 INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@classifier:v1(name=LPRNet): Resulting configuration file "/cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable_config_savant.txt" has been saved.
 INFO  insight::savant::config::module_config               > Pipeline batch size is set to 1.
 INFO  insight::savant::config::module_config               > Module configuration is complete.

(python:1): GStreamer-WARNING **: 04:48:02.167: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though.

(python:1): GStreamer-WARNING **: 04:48:04.126: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory

(python:1): GStreamer-WARNING **: 04:48:04.129: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libtritonserver.so: cannot open shared object file: No such file or directory

(python:1): GStreamer-WARNING **: 04:48:04.194: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_ucx.so': libucs.so.0: cannot open shared object file: No such file or directory
 INFO  insight::savant::engine_builder                      > GStreamer initialization done.
 INFO  insight::savant::engine_builder                      > Start building of the "yolov8n" model engine.
 INFO  insight::savant::gstreamer::runner                   > Starting pipeline `<Gst.Pipeline object at 0x7feae4b304c0 (GstPipeline at 0x55d21115c180)>`...
0:00:07.405735488     1 0x55d210f3d6f0 WARN                 nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<yolov8n> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2080> [UID = 1]: deserialize engine from file :/cache/models/license_plate_recognition/yolov8n/yolov8n.onnx_b1_gpu0_fp16.engine failed
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1487 Deserialize engine failed because file path: /cache/models/license_plate_recognition/yolov8n/yolov8n.onnx_b1_gpu0_fp16.engine open error
0:00:07.430537680     1 0x55d210f3d6f0 WARN                 nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<yolov8n> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2185> [UID = 1]: deserialize backend context from engine from file :/cache/models/license_plate_recognition/yolov8n/yolov8n.onnx_b1_gpu0_fp16.engine failed, try rebuild
0:00:07.430560831     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<yolov8n> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2106> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
WARNING: [TRT]: onnx2trt_utils.cpp:400: One or more weights outside the range of INT32 was clamped
WARNING: [TRT]: Tensor DataType is determined at build time for tensors not marked as input or output.
WARNING: [TRT]: TensorRT encountered issues when converting weights between types and that could affect accuracy.
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
WARNING: [TRT]: Check verbose logs for the list of affected weights.
WARNING: [TRT]: - 59 weights are affected by this issue: Detected subnormal FP16 values.
0:04:03.067194872     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<yolov8n> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2138> [UID = 1]: serialize cuda engine to file: /cache/models/license_plate_recognition/yolov8n/yolov8n.onnx_b1_gpu0_fp16.engine successfully
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 4
0   INPUT  kFLOAT input           3x640x640
1   OUTPUT kFLOAT boxes           8400x4
2   OUTPUT kFLOAT scores          8400x1
3   OUTPUT kFLOAT classes         8400x1

0:04:03.101507397     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<yolov8n> [UID 1]: Load new model:/cache/models/license_plate_recognition/yolov8n/yolov8n_config_savant.txt sucessfully
 INFO  insight::savant::gstreamer::runner                   > The pipeline is initialized and ready to process data. Initialization took 0:04:01.032062.
nvstreammux: Successfully handled EOS for source_id=0
 INFO  insight::savant::gstreamer::runner                   > Received EOS from pipeline0.
 INFO  insight::savant::gstreamer::runner                   > The pipeline is about to stop. Operation took 0:00:00.078820.
 INFO  insight::savant::engine_builder                      > Successfully complete the engine building of the "yolov8n" model.
 INFO  insight::savant::engine_builder                      > Start building of the "LPDNet" model engine.
 INFO  insight::savant::gstreamer::runner                   > Starting pipeline `<Gst.Pipeline object at 0x7feae4faaec0 (GstPipeline at 0x55d21115c3a0)>`...
0:04:07.945948359     1 0x55d210f3d6f0 WARN                 nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<LPDNet> NvDsInferContext[UID 2]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2080> [UID = 2]: deserialize engine from file :/cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5.onnx_b16_gpu0_int8.engine failed
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1487 Deserialize engine failed because file path: /cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5.onnx_b16_gpu0_int8.engine open error
0:04:07.973324500     1 0x55d210f3d6f0 WARN                 nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<LPDNet> NvDsInferContext[UID 2]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2185> [UID = 2]: deserialize backend context from engine from file :/cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5.onnx_b16_gpu0_int8.engine failed, try rebuild
0:04:07.973341599     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<LPDNet> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2106> [UID = 2]: Trying to create engine from model files
WARNING: [TRT]: Missing scale and zero-point for tensor block_4a_relu/Relu:0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
0:04:39.434473036     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<LPDNet> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2138> [UID = 2]: serialize cuda engine to file: /cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5.onnx_b16_gpu0_int8.engine successfully
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [FullDims Engine Info]: layers num: 3
0   INPUT  kFLOAT input_1:0       3x480x640       min: 1x3x480x640     opt: 16x3x480x640    Max: 16x3x480x640
1   OUTPUT kFLOAT output_cov/Sigmoid:0 1x30x40         min: 0               opt: 0               Max: 0
2   OUTPUT kFLOAT output_bbox/BiasAdd:0 4x30x40         min: 0               opt: 0               Max: 0

0:04:39.466541064     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<LPDNet> [UID 2]: Load new model:/cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5_config_savant.txt sucessfully
 INFO  insight::savant::gstreamer::runner                   > The pipeline is initialized and ready to process data. Initialization took 0:00:36.260744.
nvstreammux: Successfully handled EOS for source_id=0
 INFO  insight::savant::gstreamer::runner                   > Received EOS from pipeline1.
 INFO  insight::savant::gstreamer::runner                   > The pipeline is about to stop. Operation took 0:00:00.025055.
 INFO  insight::savant::engine_builder                      > Successfully complete the engine building of the "LPDNet" model.
 INFO  insight::savant::engine_builder                      > Start building of the "LPRNet" model engine.
 INFO  insight::savant::gstreamer::runner                   > Starting pipeline `<Gst.Pipeline object at 0x7feaec372600 (GstPipeline at 0x55d21115c5c0)>`...
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1487 Deserialize engine failed because file path: /cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable.etlt_b16_gpu0_fp16.engine open error
0:04:44.424806355     1 0x55d210f3d6f0 WARN                 nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<LPRNet> NvDsInferContext[UID 3]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2080> [UID = 3]: deserialize engine from file :/cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable.etlt_b16_gpu0_fp16.engine failed
0:04:44.453551890     1 0x55d210f3d6f0 WARN                 nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<LPRNet> NvDsInferContext[UID 3]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2185> [UID = 3]: deserialize backend context from engine from file :/cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable.etlt_b16_gpu0_fp16.engine failed, try rebuild
0:04:44.453568734     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<LPRNet> NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2106> [UID = 3]: Trying to create engine from model files
WARNING: [TRT]: onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
WARNING: [TRT]: Tensor DataType is determined at build time for tensors not marked as input or output.
WARNING: [TRT]: TensorRT encountered issues when converting weights between types and that could affect accuracy.
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
WARNING: [TRT]: Check verbose logs for the list of affected weights.
WARNING: [TRT]: - 25 weights are affected by this issue: Detected subnormal FP16 values.
WARNING: [TRT]: - 7 weights are affected by this issue: Detected values less than smallest positive FP16 subnormal value and converted them to the FP16 minimum subnormalized value.
0:05:36.493612978     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<LPRNet> NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2138> [UID = 3]: serialize cuda engine to file: /cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable.etlt_b16_gpu0_fp16.engine successfully
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [FullDims Engine Info]: layers num: 3
0   INPUT  kFLOAT image_input     3x48x96         min: 1x3x48x96       opt: 16x3x48x96      Max: 16x3x48x96
1   OUTPUT kINT32 tf_op_layer_ArgMax 24              min: 0               opt: 0               Max: 0
2   OUTPUT kFLOAT tf_op_layer_Max 24              min: 0               opt: 0               Max: 0

0:05:36.553289290     1 0x55d210f3d6f0 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<LPRNet> [UID 3]: Load new model:/cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable_config_savant.txt sucessfully
 INFO  insight::savant::gstreamer::runner                   > The pipeline is initialized and ready to process data. Initialization took 0:00:56.969190.
nvstreammux: Successfully handled EOS for source_id=0
 INFO  insight::savant::gstreamer::runner                   > Received EOS from pipeline2.
 INFO  insight::savant::gstreamer::runner                   > The pipeline is about to stop. Operation took 0:00:00.063724.
 INFO  insight::savant::engine_builder                      > Successfully complete the engine building of the "LPRNet" model.
bwsw commented 5 months ago

Hi, I do not understand what error you are talking about.

chanwitkepha commented 5 months ago

Hi, I do not understand what error you are talking about.

I mean GStreamer Error when run command ./scripts/run_module.py --build-engines samples/license_plate_recognition/module.yml

.............
(python:1): GStreamer-WARNING **: 04:48:02.167: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though.

(python:1): GStreamer-WARNING **: 04:48:04.126: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory

(python:1): GStreamer-WARNING **: 04:48:04.129: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libtritonserver.so: cannot open shared object file: No such file or directory

(python:1): GStreamer-WARNING **: 04:48:04.194: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_ucx.so': libucs.so.0: cannot open shared object file: No such file or directory
INFO  insight::savant::engine_builder                      > GStreamer initialization done.
................
bwsw commented 5 months ago

It is not an error. Gstreamer warnings are normally met due to various reasons like missing extra components and do on.

chanwitkepha commented 5 months ago

It is not an error. Gstreamer warnings are normally met due to various reasons like missing extra components and do on.

Because after these error result

I ran command docker compose -f samples/license_plate_recognition/docker-compose.x86.yml up

It seems these Docker Compose service is run properly but I cannot access to RTSP Server (rtsp://127.0.0.1:554/stream/video)

I already check my VLC by open others RTSP Server from another machine. It can open properly without problem

image

image

image

bwsw commented 5 months ago

It can be an error here, when you run the compose. So, you can provide compose logs. We never tested current Savant with GTX, I not even sure DS6.4 supports GTX. But i need compose logs to see.

chanwitkepha commented 5 months ago

It can be an error here, when you run the compose. So, you can provide compose logs. We never tested current Savant with GTX, I not even sure DS6.4 supports GTX. But i need compose logs to see.

Here is the complete Docker Compose Logs, Thank you.

WARN[0000] /ssd-disk3-data/devteam/Savant/samples/license_plate_recognition/docker-compose.x86.yml: `version` is obsolete 
[+] Running 2/4
 ✔ Network license_plate_recognition_default                Created                                                                                                                      0.0s 
 ✔ Volume "license_plate_recognition_zmq_sockets"           Created                                                                                                                      0.0s 
 ⠙ Container license_plate_recognition-always-on-sink-1     Created                                                                                                                      0.1s 
 ⠙ Container license_plate_recognition-module-1             Created                                                                                                                      0.1s 
 ⠋ Container license_plate_recognition-video-loop-source-1  Created                                                                                                                      0.0s 
Attaching to always-on-sink-1, module-1, video-loop-source-1
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::entrypoint > Starting the always-on-rtsp sink adapter. Packages version info: Savant 0.4.1, Savant RS 0.2.29, DeepStream 6.4.
always-on-sink-1     | 
always-on-sink-1     | (python:1): GStreamer-WARNING **: 05:23:26.511: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though.
module-1             |  INFO  insight::savant::main > Starting the module. Packages version info: Savant 0.4.1, Savant RS 0.2.29, DeepStream 6.4.
module-1             |  INFO  insight::savant::config::module_config > Configuring module "license_plate_recognition"...
module-1             |  INFO  insight::savant::config::module_config > Getting schema/configurator for zeromq_source_bin
module-1             |  INFO  insight::savant::config::module_config > Getting schema/configurator for zeromq_sink
module-1             |  INFO  insight::savant::config::module_config > Getting schema/configurator for nvinfer
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=yolov8n): Path to the model files has been set to "/cache/models/license_plate_recognition/yolov8n".
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=yolov8n): Model engine file has been set to "yolov8n.onnx_b1_gpu0_fp16.engine".
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=yolov8n): Model output converter will be used.
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=yolov8n): Resulting configuration file "/cache/models/license_plate_recognition/yolov8n/yolov8n_config_savant.txt" has been saved.
module-1             |  INFO  insight::savant::config::module_config               > Getting schema/configurator for nvinfer
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=LPDNet): Path to the model files has been set to "/cache/models/license_plate_recognition/LPDNet".
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=LPDNet): Model engine file has been set to "LPDNet_usa_pruned_tao5.onnx_b16_gpu0_int8.engine".
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@detector:v1(name=LPDNet): Resulting configuration file "/cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5_config_savant.txt" has been saved.
module-1             |  INFO  insight::savant::config::module_config               > Getting schema/configurator for nvtracker
module-1             |  INFO  insight::savant::config::module_config               > Getting schema/configurator for nvinfer
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@classifier:v1(name=LPRNet): Path to the model files has been set to "/cache/models/license_plate_recognition/LPRNet".
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@classifier:v1(name=LPRNet): Model engine file has been set to "us_lprnet_baseline18_deployable.etlt_b16_gpu0_fp16.engine".
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@classifier:v1(name=LPRNet): Model output converter will be used.
module-1             |  INFO  insight::savant::deepstream::nvinfer::element_config > Element nvinfer@classifier:v1(name=LPRNet): Resulting configuration file "/cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable_config_savant.txt" has been saved.
module-1             |  INFO  insight::savant::config::module_config               > Pipeline batch size is set to 1.
module-1             |  INFO  insight::savant::config::module_config               > Module configuration is complete.
module-1             | 
module-1             | (python:1): GStreamer-WARNING **: 05:23:27.113: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though.
always-on-sink-1     | 
always-on-sink-1     | (python:1): GStreamer-WARNING **: 05:23:27.773: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory
always-on-sink-1     | 
always-on-sink-1     | (python:1): GStreamer-WARNING **: 05:23:27.775: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libtritonserver.so: cannot open shared object file: No such file or directory
always-on-sink-1     | 
always-on-sink-1     | (python:1): GStreamer-WARNING **: 05:23:27.833: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_ucx.so': libucs.so.0: cannot open shared object file: No such file or directory
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::utils      > NVIDIA runtime is available. Using hardware-based decoding/encoding.
always-on-sink-1     |  INFO  insight::savant::deepstream::encoding          > Checking if encoder for codec 'h264' is available
always-on-sink-1     |  INFO  insight::savant::gstreamer::runner             > Starting pipeline `<Gst.Pipeline object at 0x7fbdc8265140 (GstPipeline at 0x5595ebd161d0)>`...
always-on-sink-1     |  INFO  insight::savant::gstreamer::runner             > The pipeline is initialized and ready to process data. Initialization took 0:00:00.007604.
module-1             | 
module-1             | (python:1): GStreamer-WARNING **: 05:23:28.197: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory
module-1             | 
module-1             | (python:1): GStreamer-WARNING **: 05:23:28.199: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libtritonserver.so: cannot open shared object file: No such file or directory
module-1             | 
module-1             | (python:1): GStreamer-WARNING **: 05:23:28.242: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_ucx.so': libucs.so.0: cannot open shared object file: No such file or directory
module-1             |  INFO  insight::savant::deepstream::encoding                > Checking if encoder for codec 'h264' is available
always-on-sink-1     |  INFO  insight::savant::gstreamer::runner             > Received EOS from pipeline0.
module-1             |  INFO  insight::savant::gstreamer::runner                   > Starting pipeline `<Gst.Pipeline object at 0x7f6694acfbc0 (GstPipeline at 0x558d85b940d0)>`...
module-1             |  INFO  insight::savant::gstreamer::runner                   > The pipeline is initialized and ready to process data. Initialization took 0:00:00.002137.
always-on-sink-1     |  INFO  insight::savant::deepstream::encoding          > Encoder for codec 'h264' is available
always-on-sink-1     |  INFO  insight::savant::utils::zeromq                 > Starting ZMQ source.
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::entrypoint > Started MediaMTX, PID: 40
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::stream_manager > Starting stream manager
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::stream_manager > Stream manager started
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::stream_manager > Adding stream 'video'
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::stream_manager > Starting Always-On-RTSP for source 'video', PID: 42
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::stream_manager > Stream 'video' added
always-on-sink-1     | 2024/06/05 05:23:28 INF MediaMTX v1.5.1
always-on-sink-1     | 2024/06/05 05:23:28 INF configuration loaded from /opt/savant/adapters/ds/sinks/always_on_rtsp/mediamtx.yml
always-on-sink-1     | 2024/06/05 05:23:28 INF [RTSP] listener opened on :554 (TCP), :8000 (UDP/RTP), :8001 (UDP/RTCP)
always-on-sink-1     | 2024/06/05 05:23:28 INF [RTMP] listener opened on :1935
always-on-sink-1     | 2024/06/05 05:23:28 INF [HLS] listener opened on :888
always-on-sink-1     | 2024/06/05 05:23:28 INF [WebRTC] listener opened on :8889 (HTTP), :8189 (ICE/UDP)
always-on-sink-1     |  INFO  insight::savant::gstreamer::runner                 > The pipeline is about to stop. Operation took 0:00:00.303863.
module-1             |  INFO  insight::savant::gstreamer::runner                   > Received EOS from pipeline0.
module-1             |  INFO  insight::savant::deepstream::encoding                > Encoder for codec 'h264' is available
module-1             |  INFO  insight::savant::deepstream::utils::pipeline         > No tracing provider specified. Using noop tracer.
module-1             | 
module-1             | (python:1): GStreamer-CRITICAL **: 05:23:28.482: The created element should be floating, this is probably caused by faulty bindings
module-1             | 
module-1             | (python:1): GStreamer-CRITICAL **: 05:23:28.482: The created element should be floating, this is probably caused by faulty bindings
module-1             | 
module-1             | (python:1): GStreamer-CRITICAL **: 05:23:28.483: The created element should be floating, this is probably caused by faulty bindings
module-1             | 
module-1             | (python:1): GStreamer-CRITICAL **: 05:23:28.483: The created element should be floating, this is probably caused by faulty bindings
module-1             |  INFO  insight::savant::license_plate_recognition           > Pipeline frame processing parameters: {'width': 1920, 'height': 1080, 'batch-size': 1, 'batched-push-timeout': 2000, 'live-source': False, 'interpolation-method': 6, 'drop-pipeline-eos': True, 'nvbuf-memory-type': 3}.
module-1             |  INFO  insight::savant::gstreamer::runner                   > The pipeline is about to stop. Operation took 0:00:00.326840.
always-on-sink-1     | 
always-on-sink-1     | (python:42): GStreamer-WARNING **: 05:23:28.996: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though.
always-on-sink-1     | 
always-on-sink-1     | (python:42): GStreamer-WARNING **: 05:23:29.085: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory
always-on-sink-1     | 
always-on-sink-1     | (python:42): GStreamer-WARNING **: 05:23:29.086: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libtritonserver.so: cannot open shared object file: No such file or directory
always-on-sink-1     | 
always-on-sink-1     | (python:42): GStreamer-WARNING **: 05:23:29.086: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_ucx.so': libucs.so.0: cannot open shared object file: No such file or directory
module-1             | 
module-1             | (python:1): GStreamer-CRITICAL **: 05:23:29.087: The created element should be floating, this is probably caused by faulty bindings
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink > Source video. Starting Always-On-RTSP sink
always-on-sink-1     | Fatal Python error: _PyGILState_NoteThreadState: Couldn't create autoTSSkey mapping
always-on-sink-1     | Python runtime state: initialized
always-on-sink-1     | 
always-on-sink-1     | Thread 0x00007f2386ff9640 (most recent call first):
always-on-sink-1     |   <no Python frame>
always-on-sink-1     | 
always-on-sink-1     | Thread 0x00007f23989b41c0 (most recent call first):
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 320 in wait
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 607 in wait
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 940 in start
always-on-sink-1     |   File "/opt/savant/adapters/shared/thread.py", line 38 in start
always-on-sink-1     |   File "/opt/savant/adapters/ds/sinks/always_on_rtsp/ao_sink.py", line 52 in run_ao_sink
always-on-sink-1     |   File "/opt/savant/adapters/ds/sinks/always_on_rtsp/ao_sink.py", line 74 in <module>
always-on-sink-1     |   File "/usr/lib/python3.10/runpy.py", line 86 in _run_code
always-on-sink-1     |   File "/usr/lib/python3.10/runpy.py", line 196 in _run_module_as_main
module-1             |  INFO  insight::savant::gstreamer::runner                   > Starting pipeline `license_plate_recognition<NvDsPipeline>: zeromq_source_bin:v1(name=source) -> nvstreammux:v1(name=muxer) -> nvinfer@detector:v1(name=yolov8n) -> nvinfer@detector:v1(name=LPDNet) -> nvtracker:v1(name=nvtracker0) -> nvinfer@classifier:v1(name=LPRNet) -> pyfunc:v1(name=pyfunc+gstpluginpyfunc0) -> nvstreamdemux:v1(name=demuxer)`...
module-1             |  INFO  insight::savant::healthcheck::status                 > Setting module status to ModuleStatus.STARTING.
always-on-sink-1     |  ERROR insight::savant::adapters::ao_sink::stream_manager > Always-On-RTSP for source 'video' exited. Exit code: -6.
always-on-sink-1 exited with code 0
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::entrypoint > Starting the always-on-rtsp sink adapter. Packages version info: Savant 0.4.1, Savant RS 0.2.29, DeepStream 6.4.
always-on-sink-1     | 
always-on-sink-1     | (python:1): GStreamer-WARNING **: 05:23:31.021: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though.
always-on-sink-1     | 
always-on-sink-1     | (python:1): GStreamer-WARNING **: 05:23:31.022: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.1: cannot open shared object file: No such file or directory
always-on-sink-1     | 
always-on-sink-1     | (python:1): GStreamer-WARNING **: 05:23:31.022: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libtritonserver.so: cannot open shared object file: No such file or directory
always-on-sink-1     | 
always-on-sink-1     | (python:1): GStreamer-WARNING **: 05:23:31.023: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_ucx.so': libucs.so.0: cannot open shared object file: No such file or directory
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink::utils      > NVIDIA runtime is available. Using hardware-based decoding/encoding.
module-1             | 0:00:07.398179930     1 0x7f6600003350 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<LPRNet> NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 3]: deserialized trt engine from :/cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable.etlt_b16_gpu0_fp16.engine
module-1             | INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [FullDims Engine Info]: layers num: 3
module-1             | 0   INPUT  kFLOAT image_input     3x48x96         min: 1x3x48x96       opt: 16x3x48x96      Max: 16x3x48x96      
module-1             | 1   OUTPUT kINT32 tf_op_layer_ArgMax 24              min: 0               opt: 0               Max: 0               
module-1             | 2   OUTPUT kFLOAT tf_op_layer_Max 24              min: 0               opt: 0               Max: 0               
module-1             | 
module-1             | 0:00:07.421254598     1 0x7f6600003350 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<LPRNet> NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 3]: Use deserialized engine model: /cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable.etlt_b16_gpu0_fp16.engine
module-1             | 0:00:07.423092265     1 0x7f6600003350 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<LPRNet> [UID 3]: Load new model:/cache/models/license_plate_recognition/LPRNet/us_lprnet_baseline18_deployable_config_savant.txt sucessfully
module-1             | gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
module-1             | [NvMultiObjectTracker] Initialized
module-1             | 0:00:12.308915035     1 0x7f6600003350 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<LPDNet> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 2]: deserialized trt engine from :/cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5.onnx_b16_gpu0_int8.engine
module-1             | INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [FullDims Engine Info]: layers num: 3
module-1             | 0   INPUT  kFLOAT input_1:0       3x480x640       min: 1x3x480x640     opt: 16x3x480x640    Max: 16x3x480x640    
module-1             | 1   OUTPUT kFLOAT output_cov/Sigmoid:0 1x30x40         min: 0               opt: 0               Max: 0               
module-1             | 2   OUTPUT kFLOAT output_bbox/BiasAdd:0 4x30x40         min: 0               opt: 0               Max: 0               
module-1             | 
module-1             | 0:00:12.332561041     1 0x7f6600003350 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<LPDNet> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 2]: Use deserialized engine model: /cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5.onnx_b16_gpu0_int8.engine
module-1             | 0:00:12.335133869     1 0x7f6600003350 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<LPDNet> [UID 2]: Load new model:/cache/models/license_plate_recognition/LPDNet/LPDNet_usa_pruned_tao5_config_savant.txt sucessfully
module-1             | WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
module-1             | INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 4
module-1             | 0   INPUT  kFLOAT input           3x640x640       
module-1             | 1   OUTPUT kFLOAT boxes           8400x4          
module-1             | 2   OUTPUT kFLOAT scores          8400x1          
module-1             | 3   OUTPUT kFLOAT classes         8400x1          
module-1             | 
module-1             | 0:00:17.209616257     1 0x7f6600003350 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<yolov8n> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 1]: deserialized trt engine from :/cache/models/license_plate_recognition/yolov8n/yolov8n.onnx_b1_gpu0_fp16.engine
module-1             | 0:00:17.233618871     1 0x7f6600003350 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<yolov8n> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 1]: Use deserialized engine model: /cache/models/license_plate_recognition/yolov8n/yolov8n.onnx_b1_gpu0_fp16.engine
module-1             | 0:00:17.236624730     1 0x7f6600003350 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<yolov8n> [UID 1]: Load new model:/cache/models/license_plate_recognition/yolov8n/yolov8n_config_savant.txt sucessfully
module-1             |  INFO  insight::savant::utils::zeromq                       > Starting ZMQ source.
module-1             |  INFO  insight::savant::gstreamer::runner                   > The pipeline is initialized and ready to process data. Initialization took 0:00:15.211434.
module-1             |  INFO  insight::savant::healthcheck::status                 > Setting module status to ModuleStatus.RUNNING.
video-loop-source-1  | + required_env SOURCE_ID
video-loop-source-1  | + [[ -z video ]]
video-loop-source-1  | + required_env LOCATION
video-loop-source-1  | + [[ -z https://eu-central-1.linodeobjects.com/savant-data/demo/lpr_test_1080p.mp4 ]]
video-loop-source-1  | + required_env ZMQ_ENDPOINT
video-loop-source-1  | + [[ -z dealer+connect:ipc:///tmp/zmq-sockets/input-video.ipc ]]
video-loop-source-1  | + required_env DOWNLOAD_PATH
video-loop-source-1  | + [[ -z /tmp/video-loop-source-downloads ]]
video-loop-source-1  | + ZMQ_SOCKET_TYPE=DEALER
video-loop-source-1  | + ZMQ_SOCKET_BIND=false
video-loop-source-1  | + SYNC_OUTPUT=True
video-loop-source-1  | + FPS_OUTPUT=stdout
video-loop-source-1  | + [[ -n '' ]]
video-loop-source-1  | + [[ -n '' ]]
video-loop-source-1  | + FPS_PERIOD=period-frames=1000
video-loop-source-1  | + MEASURE_FPS_PER_LOOP=false
video-loop-source-1  | + EOS_ON_LOOP_END=false
video-loop-source-1  | + READ_METADATA=false
video-loop-source-1  | + USE_ABSOLUTE_TIMESTAMPS=false
video-loop-source-1  | + SINK_PROPERTIES=(source-id="${SOURCE_ID}" eos-on-loop-end="${EOS_ON_LOOP_END}" read-metadata="${READ_METADATA}" socket="${ZMQ_ENDPOINT}" socket-type="${ZMQ_SOCKET_TYPE}" bind="${ZMQ_SOCKET_BIND}" sync="${SYNC_OUTPUT}")
video-loop-source-1  | + PIPELINE=(media_files_src_bin location="${LOCATION}" file-type=video loop-file=true download-path="${DOWNLOAD_PATH}" ! fps_meter "${FPS_PERIOD}" output="${FPS_OUTPUT}" measure-per-loop="${MEASURE_FPS_PER_LOOP}" ! adjust_timestamps !)
video-loop-source-1  | + [[ false == \t\r\u\e ]]
video-loop-source-1  | + [[ -n '' ]]
video-loop-source-1  | + PIPELINE+=(set_dts ! zeromq_sink "${SINK_PROPERTIES[@]}")
video-loop-source-1  | + trap handler SIGINT SIGTERM
video-loop-source-1  | + source /opt/savant/adapters/shared/utils.sh
video-loop-source-1  | + print_starting_message 'video-loop source adapter'
video-loop-source-1  | + local 'name=video-loop source adapter'
video-loop-source-1  | + python3 -c 'from savant.utils.welcome import get_starting_message; print(get_starting_message('\''video-loop source adapter'\''))'
video-loop-source-1  | Starting the video-loop source adapter. Packages version info: Savant 0.4.1, Savant RS 0.2.29, DeepStream 6.4.
video-loop-source-1  | + child_pid=8
video-loop-source-1  | + wait 8
video-loop-source-1  | + gst-launch-1.0 --eos-on-shutdown media_files_src_bin location=https://eu-central-1.linodeobjects.com/savant-data/demo/lpr_test_1080p.mp4 file-type=video loop-file=true download-path=/tmp/video-loop-source-downloads '!' fps_meter period-frames=1000 output=stdout measure-per-loop=false '!' adjust_timestamps '!' set_dts '!' zeromq_sink source-id=video eos-on-loop-end=false read-metadata=false socket=dealer+connect:ipc:///tmp/zmq-sockets/input-video.ipc socket-type=DEALER bind=false sync=True
video-loop-source-1  | 
video-loop-source-1  | (gst-launch-1.0:8): GStreamer-WARNING **: 05:23:46.583: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though.
video-loop-source-1  | 
video-loop-source-1  | (gst-launch-1.0:8): GStreamer-CRITICAL **: 05:23:47.201: The created element should be floating, this is probably caused by faulty bindings
video-loop-source-1  | 
video-loop-source-1  | (gst-launch-1.0:8): GStreamer-CRITICAL **: 05:23:47.201: The created element should be floating, this is probably caused by faulty bindings
video-loop-source-1  | 
video-loop-source-1  | (gst-launch-1.0:8): GStreamer-CRITICAL **: 05:23:47.201: The created element should be floating, this is probably caused by faulty bindings
video-loop-source-1  | 
video-loop-source-1  | (gst-launch-1.0:8): GStreamer-CRITICAL **: 05:23:47.201: The created element should be floating, this is probably caused by faulty bindings
video-loop-source-1  | 
video-loop-source-1  | (gst-launch-1.0:8): GStreamer-CRITICAL **: 05:23:47.201: The created element should be floating, this is probably caused by faulty bindings
video-loop-source-1  | Setting pipeline to PAUSED ...
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin > Changing state from <enum GST_STATE_NULL of type Gst.State> to <enum GST_STATE_READY of type Gst.State>
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin > 'https://eu-central-1.linodeobjects.com/savant-data/demo/lpr_test_1080p.mp4' already downloaded to PosixPath('/tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4')
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin > Reading file /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin > Changing state from <enum GST_STATE_READY of type Gst.State> to <enum GST_STATE_PAUSED of type Gst.State>
video-loop-source-1  | Pipeline is PREROLLING ...
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Sink caps changed to video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, level=(string)4, tier=(string)main, profile=(string)main-10, width=(int)1920, height=(int)1080, framerate=(fraction)25/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, chroma-format=(string)4:2:0, bit-depth-luma=(uint)10, bit-depth-chroma=(uint)10, parsed=(boolean)true
video-loop-source-1  | Pipeline is PREROLLED ...
video-loop-source-1  | Setting pipeline to PLAYING ...
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Changing state from <enum GST_STATE_PAUSED of type Gst.State> to <enum GST_STATE_PLAYING of type Gst.State>
video-loop-source-1  | Redistribute latency...
video-loop-source-1  | New clock: GstSystemClock
module-1             |  INFO  insight::savant::savant_rs_video_decode_bin          > Adding branch with source video
module-1             |  INFO  insight::savant::savant_rs_video_decode_bin          > Branch with source video added
module-1             |  INFO  insight::savant::savant_rs_video_demux               > Created new src pad for source video: src_video.
module-1             |  INFO  insight::savant::license_plate_recognition           > Added source video
video-loop-source-1  | Processed 1000 frames, 25.04 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 0 to 48280000000
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 20.91, OPS = 116.19, frame_delta = 1000, time_delta = 47.826 sec, period=[1717565027949, 1717565075775] ms
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 136.12, frame_delta = 1000, time_delta = 40 sec, period=[1717565075775, 1717565115775] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 48280000000 to 96560000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 138.90, frame_delta = 1000, time_delta = 40.001 sec, period=[1717565115775, 1717565155776] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 96560000000 to 144840000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 136.07, frame_delta = 1000, time_delta = 40.001 sec, period=[1717565155776, 1717565195777] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 144840000000 to 193120000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 136.73, frame_delta = 1000, time_delta = 39.998 sec, period=[1717565195777, 1717565235775] ms
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 193120000000 to 241400000000
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 142.03, frame_delta = 1000, time_delta = 40 sec, period=[1717565235775, 1717565275775] ms
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 137.65, frame_delta = 1000, time_delta = 39.999 sec, period=[1717565275775, 1717565315774] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 241400000000 to 289680000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 137.29, frame_delta = 1000, time_delta = 40.002 sec, period=[1717565315774, 1717565355776] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 289680000000 to 337960000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 138.07, frame_delta = 1000, time_delta = 40.001 sec, period=[1717565355776, 1717565395777] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 337960000000 to 386240000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 135.62, frame_delta = 1000, time_delta = 40 sec, period=[1717565395777, 1717565435777] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 386240000000 to 434520000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 137.73, frame_delta = 1000, time_delta = 39.998 sec, period=[1717565435777, 1717565475775] ms
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 434520000000 to 482800000000
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 24.98, OPS = 141.96, frame_delta = 1000, time_delta = 40.04 sec, period=[1717565475775, 1717565515815] ms
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.03, OPS = 137.01, frame_delta = 1000, time_delta = 39.96 sec, period=[1717565515815, 1717565555775] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 482800000000 to 531080000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 136.80, frame_delta = 1000, time_delta = 40 sec, period=[1717565555775, 1717565595775] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 531080000000 to 579360000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 24.98, OPS = 138.84, frame_delta = 1000, time_delta = 40.04 sec, period=[1717565595775, 1717565635815] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 579360000000 to 627640000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 136.02, frame_delta = 1000, time_delta = 40.001 sec, period=[1717565635815, 1717565675816] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 627640000000 to 675920000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.03, OPS = 137.96, frame_delta = 1000, time_delta = 39.96 sec, period=[1717565675816, 1717565715776] ms
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 675920000000 to 724200000000
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 24.95, OPS = 142.24, frame_delta = 1000, time_delta = 40.079 sec, period=[1717565715776, 1717565755855] ms
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.05, OPS = 135.93, frame_delta = 1000, time_delta = 39.924 sec, period=[1717565755855, 1717565795779] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 724200000000 to 772480000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.02, OPS = 137.64, frame_delta = 1000, time_delta = 39.966 sec, period=[1717565795779, 1717565835745] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 772480000000 to 820760000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 24.98, OPS = 138.77, frame_delta = 1000, time_delta = 40.031 sec, period=[1717565835745, 1717565875776] ms
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Reading from location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::media_files_src_bin                  > Set location /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::zeromq_sink::zeromq_sink+zeromqsink0 > Set location to /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Buffer DTS is 0, expected: 48280000000
video-loop-source-1  |  INFO  insight::savant::adjust_timestamps                    > Increasing offset by 48280000000: from 820760000000 to 869040000000
video-loop-source-1  | Processed 1000 frames, 25.00 FPS. Source location: /tmp/video-loop-source-downloads/savant-data/demo/lpr_test_1080p.mp4.
module-1             |  INFO  savant_core::pipeline::stats                         > Frame-based FPS counter triggered: FPS = 25.00, OPS = 135.67, frame_delta = 1000, time_delta = 40.001 sec, period=[1717565875776, 1717565915777] ms
bwsw commented 5 months ago
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink > Source video. Starting Always-On-RTSP sink
always-on-sink-1     | Fatal Python error: _PyGILState_NoteThreadState: Couldn't create autoTSSkey mapping
always-on-sink-1     | Python runtime state: initialized
always-on-sink-1     | 
always-on-sink-1     | Thread 0x00007f2386ff9640 (most recent call first):
always-on-sink-1     |   <no Python frame>
always-on-sink-1     | 
always-on-sink-1     | Thread 0x00007f23989b41c0 (most recent call first):
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 320 in wait
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 607 in wait
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 940 in start
always-on-sink-1     |   File "/opt/savant/adapters/shared/thread.py", line 38 in start
always-on-sink-1     |   File "/opt/savant/adapters/ds/sinks/always_on_rtsp/ao_sink.py", line 52 in run_ao_sink
always-on-sink-1     |   File "/opt/savant/adapters/ds/sinks/always_on_rtsp/ao_sink.py", line 74 in <module>
always-on-sink-1     |   File "/usr/lib/python3.10/runpy.py", line 86 in _run_code
always-on-sink-1     |   File "/usr/lib/python3.10/runpy.py", line 196 in _run_module_as_main

Yhis error relates to Python and from time to time occurs in unknown conditions. Very rarely, like CPU/OS combination, etc. I do not know what to suggest. Google for Fatal Python error: _PyGILState_NoteThreadState: Couldn't create autoTSSkey mapping. This is not a Savant error.

chanwitkepha commented 5 months ago
always-on-sink-1     |  INFO  insight::savant::adapters::ao_sink > Source video. Starting Always-On-RTSP sink
always-on-sink-1     | Fatal Python error: _PyGILState_NoteThreadState: Couldn't create autoTSSkey mapping
always-on-sink-1     | Python runtime state: initialized
always-on-sink-1     | 
always-on-sink-1     | Thread 0x00007f2386ff9640 (most recent call first):
always-on-sink-1     |   <no Python frame>
always-on-sink-1     | 
always-on-sink-1     | Thread 0x00007f23989b41c0 (most recent call first):
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 320 in wait
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 607 in wait
always-on-sink-1     |   File "/usr/lib/python3.10/threading.py", line 940 in start
always-on-sink-1     |   File "/opt/savant/adapters/shared/thread.py", line 38 in start
always-on-sink-1     |   File "/opt/savant/adapters/ds/sinks/always_on_rtsp/ao_sink.py", line 52 in run_ao_sink
always-on-sink-1     |   File "/opt/savant/adapters/ds/sinks/always_on_rtsp/ao_sink.py", line 74 in <module>
always-on-sink-1     |   File "/usr/lib/python3.10/runpy.py", line 86 in _run_code
always-on-sink-1     |   File "/usr/lib/python3.10/runpy.py", line 196 in _run_module_as_main

Yhis error relates to Python and from time to time occurs in unknown conditions. Very rarely, like CPU/OS combination, etc. I do not know what to suggest. Google for Fatal Python error: _PyGILState_NoteThreadState: Couldn't create autoTSSkey mapping. This is not a Savant error.

Oh, thank you, I will check it.

bwsw commented 5 months ago

Probably you have certain system constraints like thread limitations, other resource limitations configured. I do not know.

chanwitkepha commented 5 months ago

Probably you have certain system constraints like thread limitations, other resource limitations configured. I do not know.

Finally, I can solve this by add privileged: true in docker-compose.x86.yml which came with sample. Thank you for your help.

(I'm not understand it completely, but I think it's all about hardware access.)

image

image

bwsw commented 5 months ago

In out case works without privileges in most cases. Never need setting this…