Azure / aztk

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure
MIT License
150 stars 66 forks source link

SparklyR Setup #700

Open martindut opened 5 years ago

martindut commented 5 years ago

Hi. I'm following the instructions from "SparklyR on Azure with AZTK", but gets an error when I run: aztk spark cluster create --id testsparkclust4 --size 2

Error: Toolkit doesn't have an attribute called custom_scripts

Am I doing something wrong?

martindut commented 5 years ago

I managed to fire up the cluster without the custom_scripts in the config. But now, if I want to ssh in, I get this error. aztk spark cluster ssh --id testsparkclust5

spark cluster id: testsparkclust5 open webui: http://localhost:8080 open jobui: http://localhost:4040 open jobhistoryui: http://localhost:18080 plugins: rstudio_server

bash: sudo docker exec -it spark /bin/bash: No such file or directory Connection to ... closed.