G-Research / spark-extension

A library that provides useful extensions to Apache Spark and PySpark.
Apache License 2.0
193 stars 26 forks source link

Support diff for Spark Connect (Dataset API) #251

Open EnricoMi opened 2 months ago

EnricoMi commented 2 months ago

Adds support for diff for Spark Connect environments by implementing dataset logic in Python.

github-actions[bot] commented 2 months ago

Test Results

0 files   -    487  0 suites   - 487   0s ⏱️ - 1h 25m 4s 0 tests  -    515  0 ✅  -    515  0 💤 ±  0  0 ❌ ±0  0 runs   - 15 243  0 ✅  - 14 675  0 💤  - 568  0 ❌ ±0 

Results for commit 9be4a41e. ± Comparison against base commit 395998b9.

:recycle: This comment has been updated with latest results.