NVIDIA / spark-rapids-examples

A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.
Apache License 2.0
129 stars 51 forks source link

Update RAPIDS accelerated UDF Dockerfile to better match spark-rapids-jni #395

Closed jlowe closed 5 months ago

jlowe commented 5 months ago

Fixes #389, relates to #362. The C++ compiler in the RAPIDS accelerated Dockerfile is too old for recent libcudf code. This fixes the RAPIDS accelerated native UDF build by updating the Dockerfile to more closely match the build environment from spark-rapids-jni, fixing the main issue reported in #362.

Leaving #362 open, since we really should update the build to use the same Dockerfile so it keeps in sync even when spark-rapids-jni updates.