Closed ckayay closed 2 years ago
Hi Forum,
I am using:
This is the code: Similar to what has been provided here https://pydeequ.readthedocs.io/en/latest/README.html#constraint-verification
import pydeequ from pydeequ.repository import * from pydeequ.analyzers import * from pydeequ.checks import * from pydeequ.verification import * ## Initialize the Deequ Validation API ## df has the columns for 'Column_Name' checkResult = VerificationSuite(spark).onData(df) checkResult.addCheck(Check(spark, CheckLevel.Warning, "DQ Validation").isComplete('Column_Name')) checkResult.addCheck(Check(spark, CheckLevel.Warning, "DQ Validation").hasDataType('Column_Name', ConstrainableDataTypes.Integral)) ....... checkResult.run() checkResult_df = VerificationResult.checkResultsAsDataFrame(spark, checkResult) checkResult_df.show()
I am getting the following error:
~/cluster-env/clonedenv/lib/python3.8/site-packages/pydeequ/verification.py in checkResultsAsDataFrame(cls, spark_session, verificationResult, forChecks, pandas) 135 136 df = spark_session._jvm.com.amazon.deequ.VerificationResult.checkResultsAsDataFrame( --> 137 spark_session._jsparkSession, verificationResult.verificationRun, forChecks 138 ) 139 sql_ctx = SQLContext( AttributeError: 'VerificationRunBuilder' object has no attribute 'verificationRun'
Could you please help?
This is not a valid issue
Hi Forum,
I am using:
This is the code: Similar to what has been provided here https://pydeequ.readthedocs.io/en/latest/README.html#constraint-verification
I am getting the following error:
Could you please help?