jupyter-incubator / sparkmagic

Jupyter magics and kernels for working with remote Spark clusters
Other
1.32k stars 445 forks source link

Update readme with Ilum as new compatible implementation #826

Closed thijs-s closed 1 year ago

thijs-s commented 1 year ago

This change adds Ilum to the list of supported server implementations compatible with Sparkmagic.

My name is Oliver, and I am part of project Ilum, which is focused on interactive Spark sessions. We consider Ilum as a modern replacement for Apache Livy and Yarn. Last year, we added support for Sparkmagic, an aspect we are quite proud of. You can read more about how it's used in our blog post. And just recently we added full support for Python, users can now use Sparkmagic in Scala and Python.

Please consider adding a link to Ilum given the alignment between our projects and the potential benefit to our shared user community.

Thanks!