CrawlScript / WebCollector

WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
https://github.com/CrawlScript/WebCollector
GNU General Public License v3.0
3.07k stars 1.45k forks source link

BerkeleyDBReader读取berkerly种子历史文件,种子信息少了,而且执行的次数也少一次 #84

Closed haixingmu closed 6 years ago

hujunxianligong commented 6 years ago

请提供详细的代码信息