Closed vincentclaes closed 4 years ago
Hi @vincentclaes! Can you check if it runs with Spark 2.2?
thanks @FRosner using spark 2.2 did the job!
Ok. So we're gonna check why it's not working with Spark 2.3 👍
Hi Frosner.
pyddq will support fro python3 .
if it will not support , Can you suggest me the tool of data quality rule base engine .
Thanks
It doesn't support Python 3 at the moment and I'm not actively working on this project right now. If you want, feel free to submit a PR though, we'll review it asap.
I use the following versions:
python 2.7.10 pyddq==4.1.1 drunken-data-quality==4.1.1 spark 2.3.0 spark uses scala 2.11.8 java 1.8.0_162
Are there people that are able to run this? I have a feeling that this issue might be due to wrong/conflicting versions.
above test case gives the following error: