search

hubmapconsortium / airflow-dev

Configuration, workflows, and DAGs for the development instance of Airflow on HIVE infrastructure
MIT License
1 stars 0 forks source link

Add to salmon DAG #26

Closed mccalluc closed 4 years ago

mccalluc commented 4 years ago

This is how I think my task will be added after Matt's, but I could be confused? I'm also waiting on the actual CWL in PR #20.

mruffalo commented 4 years ago

I don't think this is the best approach -- I had been thinking that your pipeline would be a separate DAG entirely, which would take processed RNA-seq data as input, and produce a new data type like "RNA-seq for web frontend".

This DAG is specific to 10X RNA-seq, and we're working on others for the different assays (SNARE-seq and sci-seq), which will dump results in an identical format, so your pipeline/DAG would be triggered upon completion of any RNA-seq pipeline and wouldn't be an addition to any one in particular. Does that seem reasonable?

mccalluc commented 4 years ago

I'm happy to split it off: I think if it is more independent, we probably shouldn't describe it as one event "triggering" the next: Things just run when their preconditions are met.

@pdblood : Can you confirm that this PR should be closed and deleted?

mccalluc commented 4 years ago

On the phone call, I believed @pdblood confirmed that this is not the direction we want.