search

ohsewon / test

0 stars 0 forks source link

[ISSUE][CLOSED] [Example] negotiation problem between converter and filter. #318

Closed ohsewon closed 5 years ago

ohsewon commented 5 years ago

Issue by hello-ahn Monday Jul 23, 2018 at 04:57 GMT Originally opened as https://github.sec.samsung.net/STAR/nnstreamer/issues/318

With @jy1210-jung , @jinhyuck83-park , we are trying to get the result of Tensorflow-lite model through the example pipeline.

As I understand, the converter and filter negotiate the capability by using the dimension of input tensor. However, it is failed with no dimension information at log during the negotiation.

I attached the whole log of the pipeline.

$ ./nnstreamer_example_filter -n -v --gst-debug=3
** Message: start app..
** Message: finished to load tflite label
** Message: total labels 1001
** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:506 Debug mode on (silent off)

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:501 Setting property. for Prop 2.

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:512 Framework = tensorflow-lite

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:501 Setting property. for Prop 3.

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:529 Model = ./tflite_model/mobilenet_v1_1.0_224_quant.tflite

model loaded
** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:392 fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:396 filter: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:404 filtered fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:392 fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:396 filter: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:404 filtered fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:392 fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:396 filter: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:404 filtered fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:392 fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:396 filter: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:404 filtered fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:392 fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:396 filter: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:404 filtered fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

0:00:00.020941586  5414      0x1886c10 ERROR           GST_PIPELINE grammar.y:642:gst_parse_perform_link: could not link tensor_converter0 to tensor_filter0
** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:392 fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:396 filter: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:404 filtered fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:392 fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:396 filter: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

** Message: /home/helloahn/workspace/nnstreamer/gst/tensor_filter/tensor_filter.c:404 filtered fromCaps: other/tensor, rank=(int)[ 1, 4 ], dim1=(int)[ 1, 65535 ], dim2=(int)[ 1, 65535 ], dim3=(int)[ 1, 65535 ], dim4=(int)[ 1, 65535 ], type=(string){ float32, float64, int32, uint32, int16, uint16, int8, uint8 }, framerate=(fraction)[ 0/1, 2147483647/1 ]

0:00:00.219959347  5414      0x18a60f0 WARN          v4l2bufferpool gstv4l2bufferpool.c:540:gst_v4l2_buffer_pool_set_config:<cam_src:pool:src> libv4l2 converter detected, disabling CREATE_BUFS
0:00:00.221700222  5414      0x18a60f0 WARN          v4l2bufferpool gstv4l2bufferpool.c:748:gst_v4l2_buffer_pool_start:<cam_src:pool:src> Uncertain or not enough buffers, enabling copy threshold