VDBWRAIR / ngs_mapper

Genome Mapping Pipeline
GNU General Public License v2.0
8 stars 10 forks source link

Use Luigi? #152

Closed averagehat closed 8 years ago

averagehat commented 9 years ago

Luigi might make it easier to handle making overall pipeline changes like

110 or #150

Also will allow automatic checkpointing, diagram construction, and allows stages to be run in chunks/independently.

Edit: An initial implementation might just be to wrap each script call in runsample.py in a luigi task. Related: http://ratatosk.readthedocs.org/en/latest/dev/introduction.html

averagehat commented 8 years ago

Closing in favor of #155, as Luigi requires a running Tornado server and is more verbose. If we hit the limits of Make we can consider it among some other options.