search

rapidsai / spark-examples

[ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples
https://github.com/NVIDIA/spark-xgboost-examples
Apache License 2.0
70 stars 40 forks source link

add dockerfile #3

Closed rongou closed 5 years ago

tgravescs commented 5 years ago

is this docker file what you run locally or in gcp or both?

rongou commented 5 years ago

Uber guys want to have a docker image so that they can run it on their internal infrastructure. I haven't run it yet, will try to do it today on kubernetes on my desktop.

tgravescs commented 5 years ago

what was used to build FROM rongou/spark-gpu:a4e48359ac-2.11-kubernetes?

rongou commented 5 years ago

what was used to build FROM rongou/spark-gpu:a4e48359ac-2.11-kubernetes?

This was just built from Spark master, using the script/dockerfile in https://github.com/apache/spark/pull/23347.

I added scripts for running on Kubernetes. Please take another look.

rongou commented 5 years ago

Merging this for now. Definitely needs more iteration.