Open DennisDawson opened 9 years ago
@joey what do you think still needs to be done on this before it can be merged?
@tomwhite we need to decide on how to handle the running of the spark-submit script. The easiest way to handle that from a user perspective would be to wrap that in a shell script. I could also take care of the problem that Dennis was hitting on a fresh checkout at the same time.
I also need to test this on the 5.2 VM to see if we should just add a prep step to fix the spark directory permissions.
Thoughts?
Thanks @joey. Writing a little shell script would be good.
I'm going to go ahead and release 1.0 without this - we can update the example later on.
Makes sense to me.
Minor updates, added troubleshooting section to address issues I found. Mostly, I'm putting this up to get discussion going on what we'll do with this example in the docs for 1.0.