How to calculate the unique metrics with HLLSketchMerge

ing-bank / scruid

Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.

Apache License 2.0

115 stars 29 forks source link

Open utk14 opened 4 years ago

utk14 commented 4 years ago

Hi I was working on the generation of count distinct number for a particular metrics using DQL Aggregators but unable to implement HLLSketchMerge functionality of the druid (https://druid.apache.org/docs/latest/development/extensions-core/datasketches-hll.html) into the scruid. Can someone please help me if there is a way to compute this?

anskarl commented 4 years ago

Hi @utk14, the current version of Scruid does not support datasketches.

I think that it would be a nice addition to have datasketches in Scruid.

anskarl commented 4 years ago

Until having datasketches support in DQL, you may give a try the SQL API of Scruid v2.4.0 and use for example the APPROX_COUNT_DISTINCT_DS_HLL function