dmlc / xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
https://xgboost.readthedocs.io/en/stable/
Apache License 2.0
25.69k stars 8.67k forks source link

[jvm-packagaes] Freeze spark to 3.4.1 for now. #10253

Closed trivialfis closed 3 weeks ago

trivialfis commented 3 weeks ago

The newer spark version for CPU conflicts with the more conservative version used by rapids.

We need JSON support for JVM packages for passing various XGBoost parameters in https://github.com/dmlc/xgboost/pull/10112 . However, different spark versions require different jackson versions. This creates conflicts between packages.

trivialfis commented 3 weeks ago

cc @wbo4958 .