ctg-lund / Yggdrasil

the backbone of the CTG pipelines
0 stars 0 forks source link

Design cron script #1

Closed chaetognatha closed 8 months ago

chaetognatha commented 1 year ago

Background:

Current cron scripts are bloated. Yggdrasil should come with a minimal cron script.

The cron job should:

  1. check for new raw data
  2. set up base output structure for a project
  3. start nextflow workflow

Step 2 was initially planned to happen inside Yggdrasil, but nextflow is completely crap at handling symlinks, therefore it now happens in a cron script.

chaetognatha commented 1 year ago

Shorten process down to:

  1. check for new data
  2. start Yggdrasil
chaetognatha commented 1 year ago

This is blocked until there is a production ready Yggdrasil

chaetognatha commented 8 months ago

closing as yggdrasil is discontinued, we still need to automate, but automation of microservices will lead to one ticket per service