Can plugin be used on DLA？

NVIDIA / trt-samples-for-hackathon-cn

Simple samples for TensorRT programming

Apache License 2.0

1.47k stars 337 forks source link

Can plugin be used on DLA？ #107

Open YuKDseele opened 2 months ago

YuKDseele commented 2 months ago

I want my model to run independently on DLA, but I found that some layers aren't supported. Is it possible to create a plugin to enable DLA to run those layers?

wili-65535 commented 1 month ago

No, plugin layer is not supported by DLA (https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#dla_layers). Plugin or other layers can only be run by fallback to GPU.