Error sending http request and maximum retry encountered..

[pacuna]

I just launched a new cluster using the defaults (6 vm's in total) and every time I try to run a command in a Jupyter Notebook I get:

The code failed because of a fatal error:
    Error sending http request and maximum retry encountered..

Some things to try:
a) Make sure Spark has enough available resources for Jupyter to create a Spark context. For instructions on how to assign resources see http://go.microsoft.com/fwlink/?LinkId=717038
b) Contact your cluster administrator to make sure the Spark magics library is configured correctly.

I deleted the cluster, launched a new one and the issue persists.

---

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

• ID: e5d1e18c-9a28-c454-0db9-ae52eeb467e0
• Version Independent ID: 003a9913-ea20-708c-6e92-9ea78966ffc1
• Content: Quickstart: Create an Spark cluster in HDInsight using template
• Content Source: articles/hdinsight/spark/apache-spark-jupyter-spark-sql.md
• Service: hdinsight
• GitHub Login: @hrasheed-msft
• Microsoft Alias: hrasheed

[CHEEKATLAPRADEEP-MSFT-zz]

@pacuna Thanks for reporting this issue. We are actively investigating and will get back to you soon.

[CHEEKATLAPRADEEP-MSFT-zz]

@pacuna I’m able to run Spark SQL Statements without any issues after starting Livy for spark2 from Ambari home tab.

In Azure Portal => Go to Ambari home => On the left side click on Jupyter => Make sure Livy for Spark2 is started.

After starting Livy for Spark2: Started.

I’m able to run Spark SQL Statements without any error message.

Hope this helps.

[pacuna]

@CHEEKATLAPRADEEP-MSFT that's probably the issue. This doc doesn't mentioned anything about starting the livy service, that's why I wasn't aware. Thanks!