jesbin / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

PageFetcher is unreadable #326

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
The internal logic of pagefetcher is messed up

A refactor is in place.

Refactoring this file should achieve the following:
1. Much more readable code (logic will be simpler to follow)
2. fetchPage won't log "bad" http status codes (as it should only fetch)

Original issue reported on code.google.com by avrah...@gmail.com on 11 Dec 2014 at 7:50

GoogleCodeExporter commented 8 years ago
Fixed in rev: fa59ff2537b3

Original comment by avrah...@gmail.com on 11 Dec 2014 at 8:02