search

rerngvit / data_science

Various data science code for both large and small scale processing
0 stars 0 forks source link

I have some questions about spark installation #1

Open zt-smile opened 4 years ago

zt-smile commented 4 years ago

@rerngvit hello，Your spark configuration is great！！I want to install spark like you did，But I don't know how you installed your spark like helm install --value values.yaml ??? / ??? Can you tell me some information about the installation？

rerngvit commented 4 years ago

Hello zt-smile, I assume that you refer to the Spark K8S standalone setup ( https://github.com/rerngvit/data_science/tree/master/spark-k8s/helm-chart-standalone). Basically, I install it like with the following steps.

  1. Configure your value.xml according to your environment. For example, in my K8S setup (Micro K8S on a single node), there is a folder /data/mount_docker in the host environment for storage.
  2. then just run "helm install data-science/spark-k8s/helm-chart-standalone".

Hope this helps. Rerngvit

On Thu, Dec 12, 2019 at 1:48 PM zt-smile notifications@github.com wrote:

@rerngvit https://github.com/rerngvit hello，Your spark configuration is great！！I want to install spark like you did，But I don't know how you installed your spark like helm install --value values.yaml ??? / ??? Can you tell me some information about the installation？

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/rerngvit/data_science/issues/1?email_source=notifications&email_token=AAGHEMG2WNQZSV7OZ2NKFWLQYIXIZA5CNFSM4JZ6ADO2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IABKOTA, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAGHEMDI2NTWUVKA5RYAFDDQYIXIZANCNFSM4JZ6ADOQ .