microbiomedata / nmdc-edge

Web-based interface to the NMDC EDGE platform
https://nmdc-edge.org
4 stars 0 forks source link

automate periodic workflow tests #46

Open mflynn-lanl opened 10 months ago

mflynn-lanl commented 10 months ago

We need a way to periodically test whether the workflows are functioning properly. Automatically launch a workflow where we know what the output should be, monitor its status and report if it fails. How often we should run this is up for debate, whether daily, bi-weekly or weekly. This will help us catch issues that may crop up before we receive any user tickets. We will need one test for each pipeline, metaG, metaT, metaP, Viruses and Plasmids, and Organic Matter.

mflynn-lanl commented 10 months ago

Use a cronjob to run workflows. Upon completion a database entry will be made indicating whether the workflow failed or succeeded. This will be queried using the API to update the dashboard