Closed elmiko closed 5 years ago
@tmckayus i'm wondering if we can get this merged?
Okay going to merge, the py27 image has broken in the last couple of months but it is not the fault of this PR so we'll go ahead and merge and fix py27 in another PR. Everything passed but that one.
this change brings in a simple url and connectivity check for the spark url override. this is accomplished by inspecting the url to ensure that it is in the format
spark://host:port
, and then attempting to ensure that the connection is open byecho /dev/tcp/host/port
. if it fails for 30 seconds it will callapp_exit
.