Open whitewalker11 opened 1 year ago
@tanmayv25 @oandreeva-nv Do you have some insights into loading a YOLOv8 model with the EfficientNMS_TRT plugin in TRITON?
@whitewalker11 Did you try specifying the custom op plugin as specified here? https://github.com/triton-inference-server/server/blob/main/docs/user_guide/custom_operations.md#onnx
Issue Description:
I am encountering an error while trying to load a YOLOv8 model with the EfficientNMS_TRT plugin in TRITON. The specific error message I am receiving is:
vbnet
UNAVAILABLE: Internal: onnx runtime error 1: Load model from /models/yolov8_onnx/1/model.onnx failed: Fatal error: TRT:EfficientNMS_TRT(-1) is not a registered function/op
Steps to Reproduce:
Expected Behavior:
The YOLOv8 model with the EfficientNMS_TRT plugin should load into TRITON without any errors.
Actual Behavior:
Encountering the aforementioned error message when trying to load the model into TRITON.
Additional Information:
Possible Solutions Attempted:
Request for Assistance:
I'm seeking guidance on how to properly load a YOLOv8 model with the EfficientNMS_TRT plugin in TRITON. Any insights, suggestions, or steps to resolve this issue would be greatly appreciated. Thank you!