adstestbot[bot]
commented
5 years ago Thanks for submitting this issue. Please also check if it is already covered by an existing one, like:
Open adsbot[bot] opened 5 years ago
adstestbot[bot]
commented
5 years ago Thanks for submitting this issue. Please also check if it is already covered by an existing one, like:
Steps to Reproduce: I'm connected to the Big Data Cluster. I can run the Spark History, submit jobs etc. If I select to "Analyze in Notebook" on a file on HDFS, it creates a new Notebook with PySpark3 Kernel, which is attached to the cluster. When I run the notebook, after a long time, I get this error: Starting Spark application The code failed because of a fatal error: Invalid status code '500' from https://x.x.x.x:30443/gateway/default/livy/v1/sessions/0 with error payload:
HTTP ERROR 500
Problem accessing /gateway/default/livy/v1/sessions/0. Reason:
Powered by Jetty://
.
Some things to try: a) Make sure Spark has enough available resources for Jupyter to create a Spark context. b) Contact your Jupyter administrator to make sure the Spark magics library is configured correctly. c) Restart the kernel.