Support compression of large gRPC messages directly in client/server

quickwit-oss / quickwit

Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.

https://quickwit.io

Other

8.01k stars 327 forks source link

Support compression of large gRPC messages directly in client/server #4944

Open guilload opened 5 months ago

guilload commented 5 months ago

For potentially large messages such as ListIndexesMetadataResponse, IndexesMetadataResponse, etc., some fields are compressed/decompressed ad hoc. We would like the RPC framework to take care of that for us.

Since tonic does not support per method compression/decompression, one solution could be to rely on a custom Codec.

guilload commented 3 months ago

quickwit-oss/quickwit-datasource#131