I ran your code on GTX-1080ti and it was hardly giving 5 fps after muting visualization. I have generated a frozen graph from meta data and then tried to convert that graph to tensor-rt. But it failed to convert. Can you share frozen graph of your model or upload a converted tensor-rt model?
I ran your code on GTX-1080ti and it was hardly giving 5 fps after muting visualization. I have generated a frozen graph from meta data and then tried to convert that graph to tensor-rt. But it failed to convert. Can you share frozen graph of your model or upload a converted tensor-rt model?