search

allegro / turnilo

Business intelligence, data exploration and visualization web application for Druid, formerly known as Swiv and Pivot
https://allegro.github.io/turnilo/
Apache License 2.0
728 stars 170 forks source link

thetaSketch as a metric is not showing up in the UI #104

Open droidraja opened 6 years ago

mkuthan commented 6 years ago

Hi @droidraja

What do you mean exactly, could you provide datasource definition and Turnilo data cube configuration to reproduce the issue?

Turnilo (and Plywood under the hood) in general supports theta sketch aggregator. For theta sketch columns, Turnilo makes a Plywood query $main.countDistinct($column_name). See:

https://github.com/implydata/plywood/blob/master/src/external/utils/druidAggregationBuilder.ts#L266

However this support is very limited because there is no way to pass theta sketch parameters like size to the query. There is also no support for post aggregators like UNION, INTERSECT or NOT.

droidraja commented 6 years ago

Hey @mkuthan, Thanks for the getting back on this, the problem I am facing is that turnilo was not able to automatically find the metric field that I added as a part of metric_spec during ingestion, and even if I add the metric manually with the help of a config file - it is throwing error "Could not resolve $user_id"

jamangstangs commented 2 days ago

Hi @droidraja @mkuthan It's been a while, but still have an issue.

Turnilo get measures with using segmentMetadata query like below.

When querying segmentMetadata to specific version of druid cluster like 26.0.0, thetaSketch type measures return typeSignature and type as String, not thetaSketch. See: https://github.com/apache/druid/issues/16982

At druid version 26.0.0, segmentMetadata query return wrong measure type and turnilo not recognize them with proper measure type. I think that's the reason for you can not see thetaSketch type measures.

Is it possible to know if similar issues exist in other druid cluster and turnilo environments?