search

omarnaman / mlperf_containers

Apache License 2.0
0 stars 0 forks source link

GRPC streaming deadline not applicable #1

Open omarnaman opened 3 years ago

omarnaman commented 3 years ago

GRPC streaming only supports a deadline for the entire stream connection, and cannot be defined per query since GRPC is not implemented to expect a response for each request.

Solution

Move away from GRPC

omarnaman commented 3 years ago

Or handle the timeouts in the application layer instead.