search

timja / jenkins-gh-issues-poc-06-18

0 stars 0 forks source link

[JENKINS-55678] workspaces on agents not deleted when job is deleted #4215

Open timja opened 5 years ago

timja commented 5 years ago

When using the multi-branch plugin with GitHub projects, (many) workspaces are created on remote agents for the PR that are opened:

drwxr-xr-x 7 jenkins jenkins 4096 Jan 11 20:41 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-10-A4TA3UYZHFGPUKP2QUECANQD3JL2VJPBHZLMUT6TIVIKNQONYHSA
drwxr-xr-x 11 jenkins jenkins 4096 Jan 11 21:06 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-10-A4TA3UYZHFGPUKP2QUECANQD3JL2VJPBHZLMUT6TIVIKNQONYHSA@2
drwxr-xr-x 2 jenkins jenkins 4096 Jan 11 21:06 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-10-A4TA3UYZHFGPUKP2QUECANQD3JL2VJPBHZLMUT6TIVIKNQONYHSA@2@tmp
drwxr-xr-x 2 jenkins jenkins 4096 Jan 11 20:41 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-10-A4TA3UYZHFGPUKP2QUECANQD3JL2VJPBHZLMUT6TIVIKNQONYHSA@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 16 23:23 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-12-K4YBYTI2GVBWKWAWMLWFACIPO6556YMEJU3U2HTTSSYH3SBAE2CA
drwxr-xr-x 13 jenkins jenkins 4096 Jan 17 00:44 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-12-K4YBYTI2GVBWKWAWMLWFACIPO6556YMEJU3U2HTTSSYH3SBAE2CA@2
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 00:44 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-12-K4YBYTI2GVBWKWAWMLWFACIPO6556YMEJU3U2HTTSSYH3SBAE2CA@2@tmp
drwxr-xr-x 11 jenkins jenkins 4096 Jan 16 23:51 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-12-K4YBYTI2GVBWKWAWMLWFACIPO6556YMEJU3U2HTTSSYH3SBAE2CA@3
drwxr-xr-x 2 jenkins jenkins 4096 Jan 16 23:51 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-12-K4YBYTI2GVBWKWAWMLWFACIPO6556YMEJU3U2HTTSSYH3SBAE2CA@3@tmp
drwxr-xr-x 2 jenkins jenkins 4096 Jan 16 23:23 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-12-K4YBYTI2GVBWKWAWMLWFACIPO6556YMEJU3U2HTTSSYH3SBAE2CA@tmp
drwxr-xr-x 13 jenkins jenkins 4096 Jan 17 13:39 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ
drwxr-xr-x 13 jenkins jenkins 4096 Jan 17 13:16 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@2
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 13:16 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@2@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 17 13:16 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@3
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 13:16 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@3@tmp
drwxr-xr-x 10 jenkins jenkins 4096 Jan 17 13:17 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@4
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 13:39 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@4@tmp
drwxr-xr-x 10 jenkins jenkins 4096 Jan 17 13:16 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@5
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 13:16 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@5@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 17 13:16 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@6
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 13:16 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@6@tmp
drwxr-xr-x 10 jenkins jenkins 4096 Jan 17 13:17 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@7
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 13:39 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@7@tmp
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 13:39 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-13-EJ6LEQYAG2YDRIE575LXFMERLGLDG3HKQUQYJJZBA4CQTZIU2DTQ@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 17 13:47 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA
drwxr-xr-x 13 jenkins jenkins 4096 Jan 17 15:01 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@2
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 15:02 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@2@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 17 05:09 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@3
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 12:49 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@3@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 17 05:09 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@4
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 12:49 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@4@tmp
drwxr-xr-x 11 jenkins jenkins 4096 Jan 17 13:10 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@5
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 13:10 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@5@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 17 12:49 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@6
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 12:49 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@6@tmp
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 14:43 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-14-4IGJMYCENYDILTX53OKSBD4D4IJUHN23XJXHDF7PLW3YMJRULDLA@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 16 23:05 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-1-ZXHGQF5EDPGTOE4FCKXYRKNN4WEXWF2KNTVSW7R6MV4RC3LA62MQ
drwxr-xr-x 2 jenkins jenkins 4096 Jan 16 23:05 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-1-ZXHGQF5EDPGTOE4FCKXYRKNN4WEXWF2KNTVSW7R6MV4RC3LA62MQ@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 16 23:05 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-4-DCVW6ZWSQXWRGLHXARFWVYPLOXATJ3QRDAZS4D44Y6FQLA23A26A
drwxr-xr-x 2 jenkins jenkins 4096 Jan 16 23:05 /var/lib/jenkins/workspace/daos-stack-org_cart_PR-4-DCVW6ZWSQXWRGLHXARFWVYPLOXATJ3QRDAZS4D44Y6FQLA23A26A@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 17 22:26 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-28-XWIA4RJNY6YF3BHHQFXHVAZ2HX7EKNCLGMDCDRM7KY2MUI4WDKDA
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 22:26 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-28-XWIA4RJNY6YF3BHHQFXHVAZ2HX7EKNCLGMDCDRM7KY2MUI4WDKDA@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 17 23:51 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-30-ZIWKGJDPCQTIMDMH7IHXUQ75IFR64YT3HEXYCCZRD2LC6VOA7NMQ
drwxr-xr-x 13 jenkins jenkins 4096 Jan 18 00:20 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-30-ZIWKGJDPCQTIMDMH7IHXUQ75IFR64YT3HEXYCCZRD2LC6VOA7NMQ@2
drwxr-xr-x 2 jenkins jenkins 4096 Jan 18 00:20 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-30-ZIWKGJDPCQTIMDMH7IHXUQ75IFR64YT3HEXYCCZRD2LC6VOA7NMQ@2@tmp
drwxr-xr-x 10 jenkins jenkins 4096 Jan 18 00:18 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-30-ZIWKGJDPCQTIMDMH7IHXUQ75IFR64YT3HEXYCCZRD2LC6VOA7NMQ@3
drwxr-xr-x 2 jenkins jenkins 4096 Jan 18 00:20 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-30-ZIWKGJDPCQTIMDMH7IHXUQ75IFR64YT3HEXYCCZRD2LC6VOA7NMQ@3@tmp
drwxr-xr-x 2 jenkins jenkins 4096 Jan 17 23:51 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-30-ZIWKGJDPCQTIMDMH7IHXUQ75IFR64YT3HEXYCCZRD2LC6VOA7NMQ@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 18 11:15 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-31-N2NNN4ZNUXYOGOE2KTROAU55EQYBNXFYWBF7CRYEHLWCMHB2FCZQ
drwxr-xr-x 13 jenkins jenkins 4096 Jan 18 11:47 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-31-N2NNN4ZNUXYOGOE2KTROAU55EQYBNXFYWBF7CRYEHLWCMHB2FCZQ@2
drwxr-xr-x 2 jenkins jenkins 4096 Jan 18 11:47 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-31-N2NNN4ZNUXYOGOE2KTROAU55EQYBNXFYWBF7CRYEHLWCMHB2FCZQ@2@tmp
drwxr-xr-x 7 jenkins jenkins 4096 Jan 18 11:16 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-31-N2NNN4ZNUXYOGOE2KTROAU55EQYBNXFYWBF7CRYEHLWCMHB2FCZQ@3
drwxr-xr-x 2 jenkins jenkins 4096 Jan 18 11:16 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-31-N2NNN4ZNUXYOGOE2KTROAU55EQYBNXFYWBF7CRYEHLWCMHB2FCZQ@3@tmp
drwxr-xr-x 2 jenkins jenkins 4096 Jan 18 11:15 /var/lib/jenkins/workspace/daos-stack-org_daos_PR-31-N2NNN4ZNUXYOGOE2KTROAU55EQYBNXFYWBF7CRYEHLWCMHB2FCZQ@tmp
drwxr-xr-x 14 jenkins jenkins 4096 Dec 6 03:26 /var/lib/jenkins/workspace/daos-stack-org_iof_PR-1-36ZDJTUHC2L5VRXYR7BNL27R7UFYRY6YEVM44U4YV2BC37NWHKLA@2
drwxr-xr-x 2 jenkins jenkins 4096 Dec 6 03:26 /var/lib/jenkins/workspace/daos-stack-org_iof_PR-1-36ZDJTUHC2L5VRXYR7BNL27R7UFYRY6YEVM44U4YV2BC37NWHKLA@2@tmp
drwxr-xr-x 10 jenkins jenkins 4096 Dec 6 03:04 /var/lib/jenkins/workspace/daos-stack-org_iof_PR-1-36ZDJTUHC2L5VRXYR7BNL27R7UFYRY6YEVM44U4YV2BC37NWHKLA@3
drwxr-xr-x 2 jenkins jenkins 4096 Dec 6 03:04 /var/lib/jenkins/workspace/daos-stack-org_iof_PR-1-36ZDJTUHC2L5VRXYR7BNL27R7UFYRY6YEVM44U4YV2BC37NWHKLA@3@tmp

When the PR is merged and closed these don't seem to be getting cleaned up. This is going to very quickly result in a huge pile of stale workspaces.

Originally reported by brianjmurrell, imported from: workspaces on agents not deleted when job is deleted
  • status: Open
  • priority: Critical
  • resolution: Unresolved
  • imported: 2022/01/10
timja commented 5 years ago

josef_sustacek:

We're facing the same issue. We use PRs frequently (several a day) and each workspace dir takes several 100s of MB, so after few days, we eat up our whole 50g disk space of /tmp (where our workspaces dirs are located). PRs were closed long time ago, but all the dirs are retained, wasting the space. We never reopen PR's or anything when we merge them...