Closed PyCod closed 3 years ago
There is an implementation in this repo here: https://github.com/penolove/yolov4_triton_client/blob/master/simple_grpc_infer_client.py
I will include something similar in this repo soon, but maybe this helps you spot the difference and the issue until then.
Stay tuned for a python client in this repo, hopefully with support for video etc.
@PyCod this repo now has a full client implementation under clients/python/
If you have trouble with the new client create a new issue, I will close this one here.
Cool repo, thanks for sharing! I got yolov4 working great on triton thanks to you.
I'm interested in writing a python inference client (and share it back to the repo once it's done). I started off with the
image_client.py
example script from official nvidia repo, and after a little tweaking I got stuck.Everything seems to work just fine, I send an image to the triton engine using the http protocol and get a response back, but things go wrong in postprocessing.
Below is the logs of the triton engine when I send a request with the python client:
We can see that the output layer
prob
is supposed to have shape[1,7001,1,1]
. But in the python client I only recieve a[1, 1]
shape:It has probably something to do with it being interpreted as BYTES maybe? If I crack this and find a working python script, I'll PR it back to this repo :)
Thanks!