Add luigi workflow scripts to minimize overhead for building intermediate datasets

dsgt-birdclef / birdclef-2022

Code for the BirdCLEF 2022 competition by the DS@GT team

2 stars 3 forks source link

Add luigi workflow scripts to minimize overhead for building intermediate datasets #17

Open acmiyaguchi opened 2 years ago

acmiyaguchi commented 2 years ago

Currently, there's a set of commands that needs to be run to build all the intermediate datasets (extract motifs primarily). This is not ideal, and could be captured in a set of luigi workflow scripts.

https://luigi.readthedocs.io/en/stable/