Fix race condition with Parquet filter pushdown modifying shared hadoop Configuration

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

https://nvidia.github.io/spark-rapids

Apache License 2.0

822 stars 235 forks source link

Fix race condition with Parquet filter pushdown modifying shared hadoop Configuration #11676

Closed tgravescs closed 3 weeks ago

tgravescs commented 3 weeks ago

This is https://github.com/NVIDIA/spark-rapids/pull/11672 but against branch 24.10 specifically.

tgravescs commented 3 weeks ago

build

tgravescs commented 3 weeks ago

the failure is from not finding the 24.10.0 private jar for 4.0.0 which I assume we never released. its because we updated that to 24.10.0 from the snapshot version in the pom file.