mohankreddy / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Add support for last-modified and etag to Page class #190

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1.  Currently in WebCrawler.visit() the Page object does not contain last 
modified or etag response header values.

What is the expected output? What do you see instead?
Would be nice to specify last modified and or etach in each request as well as 
receive response.

What version of the product are you using?
3.4

Please provide any additional information below.

Original issue reported on code.google.com by dexw...@gmail.com on 1 Feb 2013 at 7:07

GoogleCodeExporter commented 9 years ago

Original comment by avrah...@gmail.com on 18 Aug 2014 at 3:33