Truncate and limit variables and onInterrupt stream cleanup for jupyter notebooks (1.1.0)

Kotlin / kotlin-spark-api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Apache License 2.0

456 stars 34 forks source link

Truncate and limit variables and onInterrupt stream cleanup for jupyter notebooks (1.1.0) #158

Closed Jolanrensen closed 2 years ago

Jolanrensen commented 2 years ago

@asm0dey So in the latest version of the notebook API, support was added for onInterrupt. Combined with catching the right exception we can now catch interrupts and make sure the spark context is stopped. It is maybe not perfect but a whole lot better than before. Now users no longer have to restart the jupyter kernel if they want to run something streaming-like again after they interrupted the kernel to stop a stream.