search

microsoft / azure-tools-for-java

Azure tools for Java, including Azure Toolkits for Eclipse, IntelliJ and related projects.
Other
239 stars 165 forks source link

[IntelliJ][Aris cluster]Could not open the Master UI link #2254

Closed jingyanjingyan closed 5 years ago

jingyanjingyan commented 6 years ago

Build: https://vscjavaci.cloudapp.net/job/Azure_Toolkits_for_Java/job/AzureToolsManager_PR/2331

Repro Steps:

  1. Link an Aris cluster Livy endpoint | https://40.121.133.199:30443/gateway/default/livy/v1 Yarn endpoint | https://40.121.133.199:30443/gateway/default/yarn

  2. Submit, click the Master UI link in output

Result: Could not launch the master UI http://mssql-master-pool-0.service-master-pool:8088/proxy/application_1539998170284_0138/

wezhang commented 5 years ago

FYI: SparkBatchJobRunner

        submissionState.setConsoleView(jobOutputView.getSecondaryConsoleView());
        submissionState.getConsoleView().addMessageFilter((line, entireLength) -> {
            //...
            String urlInLine = line.substring(3, 7);
            String mappedUrl = remoteProcess.getSparkJob().getCluster().mapInternalUrlToPublic(urlInLine);
            // Result = 
            // return Result;
        });
        submissionState.setRemoteProcessCtrlLogHandler(processHandler);
v-jiche commented 5 years ago

Bug fixed on windows. Bug repros on Linux: Build: azure-toolkit-for-intellij-2018.3.develop.943.12-29-2018

Repro Steps:

  1. Link an Aris Cluster host: 10.91.134.112 user name: root password: Yukon900
  2. Submit, click the Master UI link in output

Result: Could not launch the master UI: http://mssql-master-pool-0.service-master-pool:8088/proxy/application_1545336386529_0089/

jingyanjingyan commented 5 years ago

Verify with develop 943, it will open url like https://10.91.134.112:30443/gateway/default/yarn/