search

mozilla / jupyter-spark

Jupyter Notebook extension for Apache Spark integration
Mozilla Public License 2.0
193 stars 34 forks source link

[Question] Add progress bar to jupyter lab? #39

Open teonbrooks opened 6 years ago

teonbrooks commented 6 years ago

ATMO now has support for jupyter lab. Is there a way to enable the progress bar within jupyter lab?

teonbrooks commented 6 years ago

hey @jezdez, @harterrt mentioned you might have worked on this or might be able to help out. any suggestions?

jezdez commented 6 years ago

Woops, I missed this while I was out, sorry for the slow reply. In general this is something that would be useful for sure.

That said it I haven't looked into how to hook the progress bar into the jupyterlab's notebook frontend, which is most likely different from how the js for the usual notebook does it.

@mdboom Do you happen to have looked at how Jupyterlab works with other extensions?

mdboom commented 6 years ago

I haven't really done anything with JupyterLab, but I have some bandwidth to look into it.

jezdez commented 6 years ago

@mdboom Awesome, you can try things out on ATMO since we merged https://github.com/mozilla/emr-bootstrap-spark/commit/82fb40feee45c4a89de208e57cdd95e5479cb75f in case you're wondering. Just append /lab to the URL of the launched cluster.

vishnu2kmohan commented 6 years ago

Hey folks,

Thanks for all the awesome work.

Have you seen @krishnan-r https://github.com/krishnan-r/sparkmonitor and https://github.com/twosigma/beakerx/tree/1.0.0/beakerx/beakerx

It'd be wonderful if we can combine these efforts and view Spark Progress (incl. the many views that sparkmonitor provides) beneath a Notebook cell, in real-time within JupyterLab.

mdboom commented 6 years ago

@vishnu2kmohan : Thanks for sharing those. I wasn't personally aware of them.