search

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
550 stars 227 forks source link

tritonclient protobuf / grpcio version mismatch #787

Open tonyay163 opened 2 days ago

tonyay163 commented 2 days ago

tritonclient for Python uses _registered_method, which was added in 1.63.0 so tritonclient's deps are not correctly reflected. Additionally, grpcio 1.63.0 requires protobuf>=5, but tritonclient requires <5 strictly, which conflicts

The latest version of protobuf < 5 is 1.62.3, which gives the following error:

  File "/__w/venv/lib/python3.10/site-packages/tritonclient/grpc/aio/__init__.py", line 120, in __init__
    self._client_stub = service_pb2_grpc.GRPCInferenceServiceStub(self._channel)
  File "/__w/venv/lib/python3.10/site-packages/tritonclient/grpc/service_pb2_grpc.py", line 47, in __init__
    self.ServerLive = channel.unary_unary(
TypeError: Channel.unary_unary() got an unexpected keyword argument '_registered_method'
tonyay163 commented 2 days ago

Added a PR to fix: https://github.com/triton-inference-server/client/pull/788