search

CoxAutomotiveDataSolutions / waimak

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
Apache License 2.0
75 stars 16 forks source link

Generic sql deequ checks with commas in do not work #97

Closed vavison closed 4 years ago

vavison commented 4 years ago

Expected Behavior

We should be able to use checks with commas in such as col_a in ('abc', 'def') in the Deequ genericSqlCheck

Actual Behavior

Currently checks like these are parsed incorrectly due to splitting being done on a comma