hortonworks-spark / spark-llap

Apache License 2.0
102 stars 68 forks source link

Filters with OR is not pushed down correctly #273

Open takkarharsh opened 5 years ago

takkarharsh commented 5 years ago

https://issues.apache.org/jira/browse/HIVE-22154 As a user if we add multiple filters with "or" operator on spark dataframe it should be enclosed properly with correct brackets but in the current version of hwc multiple filters are not enclosed with proper brackets for e.g. df = df.fiter("condition1 or condition2") df = df.filter("condition3 and condition4")

the resultant query created is as follows

(condition1) or (condition2) and (condition3) and (condition4) ideally it should be as follows ((condition1) or (condition2)) and ((condition3) and (condition4))

takkarharsh commented 5 years ago

https://github.com/hortonworks-spark/spark-llap/pull/274