Open jpohanka opened 3 years ago
Thanks for bringing this up! Right now pinot broker has only one endpoint, which is http-json based.
GRPC endpoint on Pinot server is for internal usage, not exposed as a public query endpoint.
Presto can interpret the query and use grpc to fetch big trunk of data then perform more computations.
Pinot community is also considering adding a grpc endpoint for Pinot broker. Once that is added, we will support grpc client as well.
@xiangfu0 Thank you very much for the explanation!
Issue type: feature request
Pinot version: 0.8.0
Description:
We are using the Golang module for connecting with Pinot in our internal applications. So far, the JSON-based communication does not pose a bottleneck for smaller result sets (order of magnitude: 10^3).
However, for moderate result sets (order of magnitude: 10^4-10^5), the JSON-based communication starts to be inefficient.
To mitigate this, it would be convenient to implement a gRPC communication in this module, since Pinot has gRPC communication implemented internally and few other systems (i.e. PrestoDB) use this for fast fetching of the result sets.