search

awslabs / python-deequ

Python API for Deequ
Apache License 2.0
669 stars 131 forks source link

Java null pointer issue , #193

Closed koustreak closed 3 months ago

koustreak commented 4 months ago

spark version - 3.3.2 deequ jar loaded , 2.0.3-spark-3.3 PyDeequ installed using pip , version 1.2.0

I am using the below code

from pyspark.sql import SparkSession, Row import pydeequ spark = (SparkSession .builder .config("spark.jars.packages", pydeequ.deequ_maven_coord) .config("spark.jars.excludes", pydeequ.f2j_maven_coord) .getOrCreate())

I m new to deequ ,

Could you please help me with installation steps .

chenliu0831 commented 3 months ago

we don't have bandwidth troubleshooting dev setup issues. search https://github.com/awslabs/python-deequ/issues if you find anything or ask on stack overflow. Also please follow the report template next time.