search

ardianumam / Tensorflow-TensorRT

This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeNet-like model and YOLOv3 model, and get 3.7x and 1.5x faster for the former and the latter, respectively, compared to the original models.
303 stars 110 forks source link

Running against tensorRT version 0.0.0 #21

Open thebigbai opened 5 years ago

thebigbai commented 5 years ago

Dear Ardian,

Thanks for your work. However I met some issues when try to run your project.

When I ran the optimizing of YOLOv3, there was not much improvement. The tensorRT model is not right. There are some info as following:

INFO: tensorflow: Running against TensorRT version 0.0.0

it seems there is no TRTEngineOp in the model:

numb. of trt_engine_node in TensorRT graph: 0

Here is my environment : Ubuntu 16.04, tensorflow-gpu 13.1, cuda 10.1, cudnn 7.5 and tensorRT 5.1.5.0.

All the imported package is right, such as: import tensorrt import tensorflow.contrib.tensorrt as trt

Could you help me with this issue? Is my environment wrong?

Much thanks,

Bigbai

thebigbai commented 5 years ago

Problem solved.

I've tried a lot of combinations, eg. cuda(9.0,10.0,10.1)+cudnn(7.5,7.6)+TRT(5.1.5, 5.1.2,5.0.2). I found if I install tensorflow by "conda install ", this problem is always occured.

INFO: tensorflow: Running against TensorRT version 0.0.0

Then, I changed my tensorflow installation to "pip install", problem solved. I don't know why, but solved.

Cheers,

Bigbai