search

jupyter-server / enterprise_gateway

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.
https://jupyter-enterprise-gateway.readthedocs.io/en/latest/
Other
620 stars 223 forks source link

Changes for handling interrupts for PySpark Kubernetes Kernel #1114

Closed SamRanjha closed 2 years ago

SamRanjha commented 2 years ago

This PR fixes the issue #1112

Testing:

  1. Started a PySpark kernel with the changes.
  2. Started kernels and executed code followed by interrupting the same. Verified job gets killed in Spark Logs and also we can start executing other cells.
  3. Changed the spark.ui.port, added the env variable to driver and verified interrupt works.
  4. Ran jobs in threads and verified all running jobs were killed.
welcome[bot] commented 2 years ago

Thanks for submitting your first pull request! You are awesome! :hugs:
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please make sure you followed the pull request template, as this will help us review your contribution more quickly. welcome You can meet the other Jovyans by joining our Discourse forum. There is also a intro thread there where you can stop by and say Hi! :wave:
Welcome to the Jupyter community! :tada: