jupyter-incubator / sparkmagic

Jupyter magics and kernels for working with remote Spark clusters
Other
1.33k stars 447 forks source link

Plotly scala #787

Open Armadik opened 1 year ago

Armadik commented 1 year ago

Good afternoon I can't figure out how to draw graphs using spark scala kernels. The functionality works in pyspark. I would like to get something like this https://plotly.com/scala/user-guide/. Is it possible?

Strunevskiy commented 1 year ago

@Armadik I was wondering what your approach is for plotly with pyspark ?

Armadik commented 1 year ago

@Strunevskiy Zeppelin is better for scala visualization. Jupiter has almonds and torree. But at the time of my search, I did not find a convenient solution.

Strunevskiy commented 1 year ago

@Armadik what did you do for for pyspark ? I also have a solution for pyspark but want to compare to others.

Armadik commented 1 year ago

@Strunevskiy I didn't understand the question a bit. I was interested in the possibility of plotting scala graphs in jupiter notebooks. And for working with graphs through pyspark there should be no problems, there is plotly and so on...

Strunevskiy commented 1 year ago

Yes, in pyspark you can install plotly, but how do you bring visualization to notebook ?

pancodia commented 4 months ago

In pyspark kernel, I use %matplot plt