search

ardianumam / Tensorflow-TensorRT

This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeNet-like model and YOLOv3 model, and get 3.7x and 1.5x faster for the former and the latter, respectively, compared to the original models.
303 stars 110 forks source link

trt_engine_nodes in TensorRT graph: 0 #18

Closed ruyijidan closed 5 years ago

ruyijidan commented 5 years ago

TensorRT model is successfully stored! numb. of all_nodes in frozen graph: 8016 numb. of trt_engine_nodes in TensorRT graph: 0 numb. of all_nodes in TensorRT graph: 882

I don’t know why the model have no TensorRT graph and the trt model FPS is the same as original‘s. at UBUNTU1804 1080TI tensorRT=5.1.5.0 tensorflow==1.14.0

float123 commented 5 years ago

I also encountered the same problem I was thinking that maybe tenflow did not successfully use tensorrt image image Environment : ubuntu1604; 2080ti; TensorRT=5.1.5.0; tensorflow==1.14

ruyijidan commented 5 years ago

@float123 Environment :ubuntu1804 python3.5.6 cuda10.0 cudnn7.5.1.10 Tensorflow1.13,.1 TensorRT5.1.5.0

WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.2, but loaded 5.1.5. Things may not work

TensorRT model is successfully stored! numb. of all_nodes in frozen graph: 8016 numb. of trt_engine_nodes in TensorRT graph: 18 numb. of all_nodes in TensorRT graph: 73

FYI

float123 commented 5 years ago

@float123 Environment :ubuntu1804 python3.5.6 cuda10.0 cudnn7.5.1.10 Tensorflow1.13,.1 TensorRT5.1.5.0

WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.2, but loaded 5.1.5. Things may not work

TensorRT model is successfully stored! numb. of all_nodes in frozen graph: 8016 numb. of trt_engine_nodes in TensorRT graph: 18 numb. of all_nodes in TensorRT graph: 73

FYI

thank you，I use tensorflow1.13.1 and tensorrt5.0.2.6, but fps also not improve significantly. image

ruyijidan commented 5 years ago

@float123 Environment :ubuntu1804 python3.5.6 cuda10.0 cudnn7.5.1.10 Tensorflow1.13,.1 TensorRT5.1.5.0 WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.2, but loaded 5.1.5. Things may not work TensorRT model is successfully stored! numb. of all_nodes in frozen graph: 8016 numb. of trt_engine_nodes in TensorRT graph: 18 numb. of all_nodes in TensorRT graph: 73 FYI

thank you，I use tensorflow1.13.1 and tensorrt5.0.2.6, but fps also not improve significantly. image

The same as you,But I use my laptop,fps from 10 upto 18~19(GPU 970M),