search

USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
http://irds.usc.edu/sparkler/
Apache License 2.0
411 stars 143 forks source link

Store Response Headers #89

Closed thammegowda closed 7 years ago

thammegowda commented 7 years ago

Store/Index response headers of fetcher