search

USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
http://irds.usc.edu/sparkler/
Apache License 2.0
411 stars 143 forks source link

Fix for #128: Make SOLR query for generator configurable through yaml #129

Closed sujen1412 closed 6 years ago

sujen1412 commented 6 years ago

What changes were proposed in this pull request?

Allows for the generator to pick the sort order, groupBy field and sortBy field from the config yaml file.

Is this related to an already existing issue on sparkler?

128

Will it close an existing issue?
Closes #128

How was this patch tested?

There are no unit tests for this patch.

thammegowda commented 6 years ago

Thanks @sujen1412 !