It might be nice to be able to select which files to run via the command line. Here's a possible way:
The file stanzas are internally assigned a number sequentially starting from 1
User can also assign an "alias" to the file stanza via config
Add (-f) flag for files to run. The argument will be comma-separated list of aliases or numbers. If it's just numbers, ranges can be used. For example: python ingest.py -f people,places,things config.yml or python ingest.py -f 1-3,5,7 config.yml
Add (-F) flag for files not to run. Would work same way and run all files except those specified.
It would be illegal to have both -f and -F in the invocation
The skip_file parameter would continue to work as is. But it would be overridden by whatever is specified on the command line
It might be nice to be able to select which files to run via the command line. Here's a possible way:
python ingest.py -f people,places,things config.ymlorpython ingest.py -f 1-3,5,7 config.yml