search

warelab / sciapps

SciApps: a cloud-based platform for reproducible bioinformatics workflows
https://www.sciapps.org
Apache License 2.0
2 stars 1 forks source link

Delete results mainly from testing #78

Closed liyawang closed 6 years ago

liyawang commented 7 years ago

There will be a lot of data left on the data server (wildcat) while testing. To delete them, following approach might work.

  1. Mark the folder when a workflow when it is used in constructing a workflow, either by changing the folder to read only or leave a file in there (e.g. sciapps.txt)
  2. Run a cron job to delete everything that is over 15 days old and not marked
  3. Alternatively, built a script to query the workflow database and use a cron job to delete everything not captured by the database.
liyawang commented 7 years ago

If user just download a json without saving the workflow, then the workflow is not captured by the database. We should force user to save the workflow first if they want to download.

  1. Add a download link in 'My Workflow'
  2. Remove download link from diagram
liyawang commented 7 years ago

dev1, halcott, brebiou all have different databases.

We can manually check whether the folder is over 30 days old and not used by any user workflows.

liyawang commented 6 years ago

Fixed