Simplify PySpark testing with DataFrame equality functions

deordie / deordie-digest

Data Engineering Digest

https://digest.deordie.org

Creative Commons Attribution 4.0 International

26 stars 2 forks source link

Simplify PySpark testing with DataFrame equality functions #198

Closed Ceridan closed 1 week ago

Ceridan commented 3 months ago

URL: https://www.databricks.com/blog/simplify-pyspark-testing-dataframe-equality-functions

Review (1-2 sentences): Finally we have PySpark functions for testing! Starting from Spark 3.5. No more additional libraries for testing. Or, maybe..

Created by: DE or DIE Bot :robot: on behalf of https://t.me/if_no_then_yes.

Ceridan commented 1 week ago

Published in Digest #36.