search

jupyter-server / jupyter-scheduler

Run Jupyter notebooks as jobs
https://jupyter-scheduler.readthedocs.io
BSD 3-Clause "New" or "Revised" License
186 stars 23 forks source link

Delete job output folder and downloaded job files on job deletion (auto-delete) #528

Open aaaditij opened 3 weeks ago

aaaditij commented 3 weeks ago

Description

Job folder and downloaded job files are not getting deleted from the output folder (/jobs/ by default) on job deletion.

Reproduce

  1. Right-click on a notebook in the file browser and choose “Create Notebook Job” from the context menu.
  2. Go to 'Notebook Jobs' from Launcher.
  3. Once the job completes, click on 'Delete job'.

The job is removed from the Jobs list but the /jobs folder still contains the job folder and downloaded job files.

Expected behavior

Job folder and downloaded job files should be deleted from /jobs/ folder upon job deletion.

andrii-i commented 3 weeks ago

Hi @aaaditij. Thank you for creating this issue. Described behavior is an expected behavior and not a bug. We did not want to delete files in user’s output folder in case users would continue working in output files or otherwise need them after job deletion. We are open to consider “output auto-delete” feature in the future (probably as a setting) but this is not a priority / we are not working on it now.