search

awslabs / python-deequ

Python API for Deequ
Apache License 2.0
713 stars 134 forks source link

pydeequ on databricks runtime 14.0 #199

Closed hardiktalati closed 5 months ago

hardiktalati commented 5 months ago

Describe the bug A clear and concise description of what the bug is. It seems pydeequ is not working on the databricks runtime 14.0, whats the plan To Reproduce Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Smartphone (please complete the following information):

Additional context Add any other context about the problem here.

chenliu0831 commented 5 months ago

Is Spark 3.5+ support what you are looking for? If so please track in https://github.com/awslabs/python-deequ/issues/192.