search

liseryang / openbotlist

Automatically exported from code.google.com/p/openbotlist
0 stars 0 forks source link

Nutch crawl system from readrct_pipes #16

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
Need a weekly job to crawl the URLs from botlist readrct_pipes action.

Also setup for queries from solr.

Original issue reported on code.google.com by berlin.b...@gmail.com on 28 Nov 2007 at 5:38

GoogleCodeExporter commented 9 years ago 
Probably change this to the bot agent network system.

Original comment by berlin.b...@gmail.com on 29 Feb 2008 at 11:55