search

CODAIT / notebook-exporter

One Click deployment of Notebooks - Bringing Notebooks to Production
6 stars 1 forks source link

does this support pyspark notebooks too? #2

Open Tagar opened 6 years ago

Tagar commented 6 years ago

Found this on Zeppelin users list as shared by moon.

Great idea!

Does this support submitting pyspark notebooks too?

Thanks.

lresende commented 6 years ago

@Tagar currently it supports on scala notebooks, but adding support for pyspark should be simpler as you don't need to compile and generate a runnable jar and only create a single pyspark based py file. Would you like to give it a try and prototype pyspark support?

Tagar commented 6 years ago

Thanks @lresende - I have a converter from Zeppelin pyspark notebooks to .py files (with some limitations ) - see https://github.com/Tagar/stuff/blob/master/znote.py . Hopefully this can be useful somehow here too. Unfortunately I wouldn't have time to work on this anytime soon.