Feature/data integrity test

ASAP-CRN / pmdbs-sc-rnaseq-wf

Repo for testing and developing a common postmortem-derived brain sequencing (PMDBS) workflow harmonized across ASAP

Apache License 2.0

1 stars 1 forks source link

Feature/data integrity test #56

Closed kfang4 closed 3 months ago

kfang4 commented 4 months ago

To note, there are some updates in the feature/update-manifest branch that haven't been implemented yet since the pipeline isn't being rerun yet, which means this script will need to be updated when that time comes.

This script will generate a Markdown report for each team and an output log. To test:

One team: util/promote_staging_data -t team-lee
Multiple teams: util/promote_staging_data -t team-lee,team-jakobsson

kfang4 commented 4 months ago

All comments make sense- will implement these changes. One thing, the order operations would instead be:

Test data
Write report locally; include paths to the previous and current manifests (even if you haven't yet written the current manifest to that loc)
Copy report and manifest to the metadata/${timestamp} directory.
Promote data

If data is promoted, the prod manifests will be overwritten.

kfang4 commented 3 months ago

Dave (MJFF) reviewed report.

kfang4 commented 3 months ago

@hkeward Added a description for data integrity test result tables as per Dave's request. Merging.