USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
http://irds.usc.edu/sparkler/
Apache License 2.0
411 stars 143 forks source link

Setup unit tests and integration tests for Sparkler #32

Closed thammegowda closed 3 years ago

thammegowda commented 7 years ago

To begin with, write unit tests for :

Tasks

PS: The current progress can be tracked on https://github.com/USCDataScience/sparkler/tree/unittests branch