USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
http://irds.usc.edu/sparkler/
Apache License 2.0
411 stars 143 forks source link

Define config file as cmd line flag #115

Closed buggtb closed 3 years ago

buggtb commented 7 years ago

Issue Description

It would be cool to override the config file as a whole on the cmd line so that lots of options could be updated in one place.

How to reproduce it

Environment and Version Information

All environments.

An external links for reference

Contributing

I'll fix this.