Open JeroendenBoef opened 1 year ago
Hi, I will do some tests and update the code soon.
I am working on Jetson Tx2,DeepStream 6.0. I am too getting the same error as above.
I am working on Jetson Tx2,DeepStream 6.0. I am too getting the same error as above.
You can backport the TRT plugin from 8.5.1 or higher to your current TRT version by compiling it as a standalone plugin, registering it with TRT as custom plugin, and loading the custom lib at runtime. If you use python bindings, you can load it at runtime with:
import ctypes
ctypes.CDLL("/path/to/custom/plugin/libRoiAlignPlugin.so", mode=ctypes.RTLD_GLOBAL)
I am working on Jetson Tx2,DeepStream 6.0. I am too getting the same error as above.
You can backport the TRT plugin from 8.5.1 or higher to your current TRT version by compiling it as a standalone plugin, registering it with TRT as custom plugin, and loading the custom lib at runtime. If you use python bindings, you can load it at runtime with:
import ctypes ctypes.CDLL("/path/to/custom/plugin/libRoiAlignPlugin.so", mode=ctypes.RTLD_GLOBAL)
Do you have solve the problem?
I am working on Jetson Tx2,DeepStream 6.0. I am too getting the same error as above.
You can backport the TRT plugin from 8.5.1 or higher to your current TRT version by compiling it as a standalone plugin, registering it with TRT as custom plugin, and loading the custom lib at runtime. If you use python bindings, you can load it at runtime with:
import ctypes ctypes.CDLL("/path/to/custom/plugin/libRoiAlignPlugin.so", mode=ctypes.RTLD_GLOBAL)
Do you have solve the problem?
Compiling the RoiAlignPlugin as standalone TRT plugin and importing it like this does work and it would allow you to run the this instance segmentation app on Jetpack versions lower than 5.1. We were experiencing some drops on throughput on our setup, which in the end was likely due to bad industrial Jetson boards from our hardware supplier. We have since switched suppliers and now have access to the higher Jetpack version, so we haven't tested the backport setup to see if the performance issues were not related to this.
I would recommend upgrading to Jetpack 5.1 or higher if possible. If this is not an option and it would still be helpful to people, I could give some instructions on how to compile RoiAlign as a standalone plugin and import it in your deepstream app. Alternatively, I could make a PR with the guide so that it is included in the repo @marcoslucianops , whichever you prefer.
I am working on Jetson Tx2,DeepStream 6.0. I am too getting the same error as above.
You can backport the TRT plugin from 8.5.1 or higher to your current TRT version by compiling it as a standalone plugin, registering it with TRT as custom plugin, and loading the custom lib at runtime. If you use python bindings, you can load it at runtime with:
import ctypes ctypes.CDLL("/path/to/custom/plugin/libRoiAlignPlugin.so", mode=ctypes.RTLD_GLOBAL)
Do you have solve the problem?
Compiling the RoiAlignPlugin as standalone TRT plugin and importing it like this does work and it would allow you to run the this instance segmentation app on Jetpack versions lower than 5.1. We were experiencing some drops on throughput on our setup, which in the end was likely due to bad industrial Jetson boards from our hardware supplier. We have since switched suppliers and now have access to the higher Jetpack version, so we haven't tested the backport setup to see if the performance issues were not related to this.
I would recommend upgrading to Jetpack 5.1 or higher if possible. If this is not an option and it would still be helpful to people, I could give some instructions on how to compile RoiAlign as a standalone plugin and import it in your deepstream app. Alternatively, I could make a PR with the guide so that it is included in the repo @marcoslucianops , whichever you prefer.
If i upgrade to Jetpack 5.1, does it work?
I am working on Jetson Tx2,DeepStream 6.0. I am too getting the same error as above.
You can backport the TRT plugin from 8.5.1 or higher to your current TRT version by compiling it as a standalone plugin, registering it with TRT as custom plugin, and loading the custom lib at runtime. If you use python bindings, you can load it at runtime with:
import ctypes ctypes.CDLL("/path/to/custom/plugin/libRoiAlignPlugin.so", mode=ctypes.RTLD_GLOBAL)
Do you have solve the problem?
Compiling the RoiAlignPlugin as standalone TRT plugin and importing it like this does work and it would allow you to run the this instance segmentation app on Jetpack versions lower than 5.1. We were experiencing some drops on throughput on our setup, which in the end was likely due to bad industrial Jetson boards from our hardware supplier. We have since switched suppliers and now have access to the higher Jetpack version, so we haven't tested the backport setup to see if the performance issues were not related to this. I would recommend upgrading to Jetpack 5.1 or higher if possible. If this is not an option and it would still be helpful to people, I could give some instructions on how to compile RoiAlign as a standalone plugin and import it in your deepstream app. Alternatively, I could make a PR with the guide so that it is included in the repo @marcoslucianops , whichever you prefer.
If i upgrade to Jetpack 5.1, does it work?
Jetpack 5.1 and its minor versions (5.1.1 and 5.1.2) come with TensorRT 8.5.2, which has the RoiAlign plugin, so it should work on Jetpack 5.1.
I am working on Jetson Tx2,DeepStream 6.0. I am too getting the same error as above.
You can backport the TRT plugin from 8.5.1 or higher to your current TRT version by compiling it as a standalone plugin, registering it with TRT as custom plugin, and loading the custom lib at runtime. If you use python bindings, you can load it at runtime with:
import ctypes ctypes.CDLL("/path/to/custom/plugin/libRoiAlignPlugin.so", mode=ctypes.RTLD_GLOBAL)
Do you have solve the problem?
Compiling the RoiAlignPlugin as standalone TRT plugin and importing it like this does work and it would allow you to run the this instance segmentation app on Jetpack versions lower than 5.1. We were experiencing some drops on throughput on our setup, which in the end was likely due to bad industrial Jetson boards from our hardware supplier. We have since switched suppliers and now have access to the higher Jetpack version, so we haven't tested the backport setup to see if the performance issues were not related to this. I would recommend upgrading to Jetpack 5.1 or higher if possible. If this is not an option and it would still be helpful to people, I could give some instructions on how to compile RoiAlign as a standalone plugin and import it in your deepstream app. Alternatively, I could make a PR with the guide so that it is included in the repo @marcoslucianops , whichever you prefer.
If i upgrade to Jetpack 5.1, does it work?
Jetpack 5.1 and its minor versions (5.1.1 and 5.1.2) come with TensorRT 8.5.2, which has the RoiAlign plugin, so it should work on Jetpack 5.1.
Yes, you are right, bro! It can work as yolo as well,and i want to ask another question: how to change the color of the mask and how to put the text in the middle of the mask?
Thanks for publishing your instance segmentation implementation, greatly appreciated!
My setup:
Generating a TRT engine on a Jetson AGX Xavier with deepstream 6.1.1 causes an error due to the RoiAlign plugin not being implemented until TRT 8.5.1. Due to a custom L4T kernel, I cannot switch to Jetpack 5.1.
Have you manage to get it to work on Jetpack 5.0.2? If not, would you have any pointers on a workaround? I was looking into grabbing NVIDIAs RoiAlign and adding it as a custom plugin to TRT 8.4.1, however I am unsure whether I have everything I need for that with just this snippet.
The full error trace: