isarsoft / yolov4-triton-tensorrt

This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
http://www.isarsoft.com
Other
276 stars 63 forks source link

tritonclient.utils.InferenceServerException: [StatusCode.UNIMPLEMENTED] #48

Closed CPFelix closed 2 years ago

CPFelix commented 3 years ago

I had successfully test the engine with standalone TensorRT, but when I tried to run on Triton, I got the error. “ (yolov4-triton) chen@ubuntu-X785-G30:~/yolov4-triton-tensorrt-1.3.0/clients/python$ python client.py -o data/dog_result.jpg image data/dog.jpg Traceback (most recent call last): File "client.py", line 120, in if not triton_client.is_server_live(): File "/home/chen/anaconda3/envs/yolov4-triton/lib/python3.7/site-packages/tritonclient/grpc/init.py", line 217, in is_server_live raise_error_grpc(rpc_error) File "/home/chen/anaconda3/envs/yolov4-triton/lib/python3.7/site-packages/tritonclient/grpc/init.py", line 61, in raise_error_grpc raise get_error_grpc(rpc_error) from None tritonclient.utils.InferenceServerException: [StatusCode.UNIMPLEMENTED] ” Is the problem relevent with version of grpc?

philipp-schmidt commented 2 years ago

Make sure that your triton version matches the version of the tritonclient python pip package that you install. Check requirements.txt in this repo to see the versioning and compare with your versions of triton and tritonclient