USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
http://irds.usc.edu/sparkler/
Apache License 2.0
411 stars 143 forks source link

Time taken by HTTP servers to provide a web page #144

Closed voltek62 closed 6 years ago

voltek62 commented 6 years ago

It seems 'Response Time' is not stored in Solr at the moment, can you add a fix to store fetch time in Solr ?

All the best