search

NVIDIA-AI-IOT / tf_trt_models

TensorFlow models accelerated with NVIDIA TensorRT
BSD 3-Clause "New" or "Revised" License
681 stars 245 forks source link

subgraph conversion error for subgraph And when loop detect one image, fps change lower with loop go on. #42

Closed xiaowenhe closed 5 years ago

xiaowenhe commented 5 years ago

I met two question. First, like , subgraph conversion error for subgraph_index:0 due to: "Unimplemented: Operation: GatherV2 does not support tensor input as indices, at: Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/FilterGreaterThan_37/Gather/GatherV2" SKIPPING......( 91 nodes) 2019-02-28 09:14:17.579506: E tensorflow/contrib/tensorrt/log/trt_logger.cc:38] DefaultLogger Parameter check failed at: ../builder/Network.cpp::addInput::364, condition: isValidDims(dims) 2019-02-28 09:14:17.579643: W tensorflow/contrib/tensorrt/convert/convert_graph.cc:515] subgraph conversion error for subgraph_index:1 due to: "Invalid argument: Failed to create Input layer" SKIPPING......( 180 nodes) 2019-02-28 09:14:17.583141: E tensorflow/contrib/tensorrt/log/trt_logger.cc:38] DefaultLogger Parameter check failed at: ../builder/Network.cpp::addInput::364, condition: isValidDims(dims) 2019-02-28 09:14:17.583251: W tensorflow/contrib/tensorrt/convert/convert_graph.cc:515] subgraph conversion error for subgraph_index:2 due to: "Invalid argument: Failed to create Input layer" SKIPPING......( 91 nodes) 2019-02-28 09:14:17.855174: I tensorflow/contrib/tensorrt/convert/convert_nodes.cc:3273] Max batch size= 1 max workspace size= 15239862 2019-02-28 09:14:17.855271: I tensorflow/contrib/tensorrt/convert/convert_nodes.cc:3277] Using FP16 precision mode 2019-02-28 09:14:17.855298: I tensorflow/contrib/tensorrt/convert/convert_nodes.cc:3279] starting build engine 2019-02-28 09:15:27.723945: I tensorflow/contrib/tensorrt/convert/convert_nodes.cc:3284] Built network 2019-02-28 09:15:27.983354: I tensorflow/contrib/tensorrt/convert/convert_nodes.cc:3289] Serialized engine 2019-02-28 09:15:27.989671: I tensorflow/contrib/tensorrt/convert/convert_nodes.cc:3297] finished engine my_trt_op3 containing 399 nodes 2019-02-28 09:15:27.989829: I tensorflow/contrib/tensorrt/convert/convert_nodes.cc:3304] Finished op preparation 2019-02-28 09:15:28.006885: I tensorflow/contrib/tensorrt/convert/convert_nodes.cc:3313] OK finished op building for my_trt_op3 on device 2019-02-28 09:15:28.019061: E tensorflow/contrib/tensorrt/log/trt_logger.cc:38] DefaultLogger Parameter check failed at: ../builder/Network.cpp::addInput::364, condition: isValidDims(dims) 2019-02-28 09:15:28.019268: W tensorflow/contrib/tensorrt/convert/convert_graph.cc:515] subgraph conversion error for subgraph_index:4 due to: "Invalid argument: Failed to create Input layer" SKIPPING......( 812 nodes) 2019-02-28 09:15:28.022909: E tensorflow/contrib/tensorrt/log/trt_logger.cc:38] DefaultLogger Parameter check failed at: ../builder/Network.cpp::addInput::364, condition: isValidDims(dims) 2019-02-28 09:15:28.023033: W tensorflow/contrib/tensorrt/convert/convert_graph.cc:515] subgraph conversion error for subgraph_index:5 due to: "Invalid argument: Failed to create Input layer" SKIPPING......( 91 nodes) 2019-02-28 09:15:28.026248: E tensorflow/contrib/tensorrt/log/trt_logger.cc:38] DefaultLogger Parameter check failed at: ../builder/Network.cpp::addInput::364, condition: isValidDims(dims) 2019-02-28 09:15:28.026375: W tensorflow/contrib/tensorrt/convert/convert_graph.cc:515] subgraph conversion error for subgraph_index:6 due to: "Invalid argument: Failed to create Input layer" SKIPPING......( 93 nodes)

Second , the fps number change lower when I loop detect one image. INFO:main:starting to loop and detect. fps: 20.40725928088357 fps: 18.45935037996668 fps: 16.751810248984217 fps: 15.24339697527394 fps: 13.87311701215418 fps: 12.647912411364446 fps: 11.554539115658597 fps: 10.55662194967356 fps: 9.698609523401107 fps: 8.908598441178839 fps: 8.166230613095797 fps: 7.5197477917014535 fps: 6.959576719278569 fps: 6.410740168645285 fps: 5.916197277081991 fps: 5.556488737254684 fps: 5.168263848609842 fps: 4.834741166442536 fps: 4.53864476499229 fps: 4.264259366189802 fps: 4.010705880051854 fps: 3.724590941129009 fps: 3.5302278777241947 fps: 3.380465156750385 fps: 3.208263288248047 fps: 3.0406342368439874 fps: 2.928060590611087 fps: 2.873218830414652 fps: 2.7783801820319765 fps: 2.651907419900453 fps: 2.480411458345657 fps: 2.416111572401144 fps: 2.3129406820534624 fps: 2.255962378473225 fps: 2.177369284807169 fps: 2.138038598816302 fps: 2.1001961426642466 fps: 2.051187453237581 fps: 2.020784055840426 fps: 2.0304545929767412 fps: 2.0150360488983363 fps: 1.9953965241200242 fps: 1.963710877321159 fps: 1.948278107208975 fps: 1.9227513807195553 fps: 1.8743993135525407 fps: 1.9034719956981463 fps: 1.9100180144137575 fps: 1.8847275863332658 fps: 1.910353920728798 fps: 1.9060315274170423 fps: 1.850527859182863 fps: 1.8262420378562454 fps: 1.8340284447204942 fps: 1.7066448639223182 fps: 1.576937409745135

Can anyone help me? Thank you!