molgenis / molgenis-emx2

MOLGENIS EMX2, the latest version of the MOLGENIS data platform.
GNU Lesser General Public License v3.0
14 stars 18 forks source link

After upgrading the server scheduled jobs stop running #3372

Closed dtroelofsprins closed 5 months ago

dtroelofsprins commented 8 months ago

What version of EMX2 are you using (see footer) v10.35.2 (but also in previous versions)

Describe the bug After upgrading a server using the AWX "Emx2 backend update playbook" template, scheduled scripts stop running. Only after opening and saving the script again it starts running again.

To Reproduce Steps to reproduce the behavior:

  1. Go to 'https://bbmri-emx2-test.molgeniscloud.org'
  2. Schedule for example the "Hello world" job to run every minute (0 0/1 * ?)
  3. Check if the job runs (for several times)
  4. Upgrade the server using the AWX "Emx2 backend update playbook" template
  5. Wait five minutes => the job doesn't run anymore
  6. Open the script and save it (no adjustments needed) => the job starts running again

Expected behavior After upgrading the server, scheduled jobs keep running.

mswertz commented 7 months ago

So it seems the cron task manager is not restarting when server is restarted

dtroelofsprins commented 7 months ago

Today discussed during OPS weekly meeting, Ruben is going check on the server side how and what regarding the cron job after a restart.