This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeNet-like model and YOLOv3 model, and get 3.7x and 1.5x faster for the former and the latter, respectively, compared to the original models.
your_outputs = ["Placeholder:0", "concat_9:0", "mul_9:0"]
trt_graph = trt.create_inference_graph(
input_graph_def=frozen_graph,# frozen model
outputs=your_outputs,
max_batch_size=1,# specify your max batch size
max_workspace_size_bytes=2*(10**9),# specify the max workspace
precision_mode="FP16") # precision, can be "FP32" (32 floating point precision) or "FP16"
and I get a segmentation fault. -> [1] 20875 segmentation fault (core dumped) sudo python3 yoloconvert.py
When I run ipynb 7, and specifically
your_outputs = ["Placeholder:0", "concat_9:0", "mul_9:0"] trt_graph = trt.create_inference_graph( input_graph_def=frozen_graph,# frozen model outputs=your_outputs, max_batch_size=1,# specify your max batch size max_workspace_size_bytes=2*(10**9),# specify the max workspace precision_mode="FP16") # precision, can be "FP32" (32 floating point precision) or "FP16"
and I get a segmentation fault. -> [1] 20875 segmentation fault (core dumped) sudo python3 yoloconvert.py
Anyone else run into this problem?