issues
search
G-Research
/
spark-extension
A library that provides useful extensions to Apache Spark and PySpark.
Apache License 2.0
193
stars
26
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Support diff for Spark Connect (Plugin)
#258
EnricoMi
opened
2 weeks ago
1
Make ` Column.expr` accessible
#257
EnricoMi
closed
2 weeks ago
1
Support Spark4 Column Node API
#256
EnricoMi
closed
2 weeks ago
1
Move to Spark 3.5.3-SNAPSHOT
#255
EnricoMi
closed
3 weeks ago
0
Simplify getDiffColumns logic
#254
EnricoMi
closed
3 weeks ago
0
Improve test success job
#253
EnricoMi
closed
3 weeks ago
1
Add ignore columns to diff in Python API
#252
EnricoMi
closed
3 weeks ago
1
Support diff for Spark Connect (Dataset API)
#251
EnricoMi
opened
3 weeks ago
1
Check that the Java / Scala package is installed when needed
#250
EnricoMi
closed
3 weeks ago
1
Support diff with ignore columns in Python
#249
EnricoMi
closed
3 weeks ago
0
Support Spark Connect server
#248
EnricoMi
opened
1 month ago
4
Detect and test Spark Connect server
#247
EnricoMi
closed
3 weeks ago
1
Not able to use spark-extension package with Spark Connect server / Databricks 14.x runtime
#246
shri-0509
opened
1 month ago
5
Fix: Change env for publishing snapshot release
#245
ljubon
opened
1 month ago
6
Check that the Java / Scala package is installed when needed
#244
EnricoMi
closed
3 weeks ago
1
Test Spark 4.0.0 preview
#243
EnricoMi
opened
3 months ago
1
Error: 'JavaPackage' object is not callable
#242
rish-shar
opened
3 months ago
4
CI: Fix warnings & deprecation messages in the workflows
#241
ljubon
closed
3 months ago
1
Update changelog
#240
EnricoMi
closed
4 months ago
1
Upgrade to Spark 3.4.4 snapshot
#239
EnricoMi
closed
4 months ago
1
Changeset values should honor comparators
#238
ets
closed
4 months ago
5
CI: Release workflow
#237
ljubon
closed
2 months ago
5
Remove Scala 2.12 for Spark 4 snapshot
#236
EnricoMi
closed
5 months ago
1
Reduce cache cardinality
#235
EnricoMi
closed
5 months ago
2
Account for changed exception message in Spark 4
#234
EnricoMi
closed
5 months ago
1
Spark 3.5.1 has been released, bump snapshot versions and pom.xml
#233
EnricoMi
closed
5 months ago
1
Spark extension not working with 3.5.1
#232
datanikkthegreek
closed
5 months ago
3
Pyspark - Import Error
#231
VinothKanna007
closed
7 months ago
5
PySpark - Diff Epsilon Inclusive vs Exclusive
#230
VinothKanna007
closed
7 months ago
4
Merge Differ.diff_with_options into Differ.diff and check input types
#229
EnricoMi
opened
7 months ago
0
Check Python input types
#228
EnricoMi
opened
7 months ago
0
Diff Issue
#227
VinothKanna007
closed
7 months ago
4
Add map diff comparator to Python API
#226
EnricoMi
closed
7 months ago
1
Comparators error when using pyspark
#225
hbashary
closed
7 months ago
6
Move python dependencies into tests_require
#224
EnricoMi
closed
8 months ago
1
Add install-python-deps example
#223
EnricoMi
closed
8 months ago
1
Make create_temporary_dir work with pyspark-extension only
#222
EnricoMi
closed
8 months ago
1
Sync python/README.md with README.md
#221
EnricoMi
closed
8 months ago
1
Upgrade dependencies
#220
EnricoMi
closed
8 months ago
2
Fix skipped poetry install tests
#219
EnricoMi
closed
8 months ago
1
Debug CI test results
#218
EnricoMi
closed
8 months ago
2
Upgrade Spark patch versions
#217
EnricoMi
closed
8 months ago
1
Add install_poetry_project
#216
EnricoMi
closed
8 months ago
1
Allow to install PIP packages into PySpark job
#215
EnricoMi
closed
8 months ago
1
CI upgrade to Spark 3.4.3 snapshot
#214
EnricoMi
closed
9 months ago
1
Provide groupByKey shortcuts for groupBy.as
#213
EnricoMi
closed
9 months ago
1
Apply scalafmt changes, check during compile phase
#212
EnricoMi
closed
8 months ago
1
Add columns, values and nulls count where possible
#211
EnricoMi
closed
9 months ago
1
Diff: diff method throws IllegalArgumentException when specifying multiple id columns
#210
mschawag
closed
9 months ago
2
Add more columns to reading parquet metadata
#209
EnricoMi
closed
9 months ago
1
Next