-
I need to update the environment variables of the SparkSubmit process (i need to add PYSPARK_PYTHON to support using a conda environment).
However, i can't figure out how to do this (apart from upda…
-
- Azure Data Studio Version:
Version 1.9.0
Commit: 78a42e1d112ae3231777722b51eaf44f83ddbe55
Steps to Reproduce:
1. Install the python packages 'plotly' and 'plotly.express' on an aris clust…
-
Ran into below exception after Livy restart.
Livy has `livy.server.recovery.mode` = `recovery` and there was one session in `livy.server.recovery.state-store`
Is session recovery not supporte…
Tagar updated
5 years ago
-
Remote session management
-
we have setup cdh 6.2 in our cluster, hue config as
```
[desktop]
app_blacklist=
[notebook]
show_notebooks=true
```
livy 0.6.0 has been installed, and OS environment export as:
```
exp…
-
I've been working with Papermill and Sparkmagic, and have noticed that whenever a Spark error occurs while using Sparkmagic in a Jupyter notebook, Papermill does not throw an error which it should. I …
mbrio updated
5 years ago
-
Hi,
I followed this section to start a jar deployed to the headnodes: Updates to Livy configuration starting with HDInsight 3.5 version.
I'm using HDI 3.6 and no default-livy config exists in the amb…
-
We have written the needed data into your clipboard because it was too large to send. Please paste.
-
I realize this is a common issue for xgboost installs via pip, but none of the proposed solutions are working for me.
python version `3.6.8`
using conda virtual env
I am trying to install xgboo…
-
Ive been playing with a dataset in Spark using sparklyr and a Livy connection, but running into an issue when trying to build a predictive model.
I got the data loaded just fine, was able to creat…