search

microsoft / Mobius

C# and F# language binding and extensions to Apache Spark
MIT License
943 stars 213 forks source link

Jupyter notebook integration? #623

Open Aaronontheweb opened 7 years ago

Aaronontheweb commented 7 years ago

Are there any docs or examples out there that explain how to launch Mobius jobs from within a Juypter notebook (or equivalent, like Azure Notebooks?)

skaarthik commented 7 years ago

This is not supported out of the box. Few months back, I tried using IFsharp kernel with JuPyter and got the basic functionality working. However, for some reason Jupyter kept restarting IFSharp kernel and that needed "reestablish session" feature in Mobius CLR-JVM bridge. I have not tried recently but if the IFSharp restart issue is already addressed, then it might be possible to use Jupyter & IFSharp kernel the way interactive F# usage in Mobius; otherwise, Mobius needs to be updated to support restablishing sessions.