search

USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
http://irds.usc.edu/sparkler/
Apache License 2.0
410 stars 143 forks source link

[SPARKLER 33] Disable kafka by default with kafka.enabled parameter #35

Closed rahulpalamuttam closed 8 years ago

rahulpalamuttam commented 8 years ago

The following PR addresses issue #33

  1. kafka.enabled parameter has been added with default value as false. Note that the yaml class reads this in as a boolean.
  2. The config parameter is checked before sending content to kafka

@thammegowda @karanjeets