search

aws-samples / sagemaker-studio-sparkmagic-lib

MIT No Attribution
7 stars 8 forks source link

Unable to connect sometimes when cluster size is greater than instance pagination limit #2

Closed mnutt closed 3 years ago

mnutt commented 3 years ago

Sparkmagic only fetches the first [50] cluster instances, and in a larger cluster the master node may not be in this list. It results in this error:

UnboundLocalError: local variable 'master_instance_details' referenced before assignment

...which happens because it can't compare MasterPublicDnsName.