The data transmission between query servers and result mergers is the major source of query latency

ADSC-Cloud / Waterwheel

Waterwheel is a distributed append-only store supporting millions insertions per second and realtime temporal and key range query

14 stars 9 forks source link

The data transmission between query servers and result mergers is the major source of query latency #81

Open wangli1426 opened 6 years ago

wangli1426 commented 6 years ago

I found that the query response for query with aggregate is much shorter than that without aggregate. This indicates that the data transmission between the query servers and the result merges is the performance bottleneck in query evaluation.

We may want to reduce the data transmission overhead by using compression and/or kryo Serializer.