search

liseryang / openbotlist

Automatically exported from code.google.com/p/openbotlist
0 stars 0 forks source link

Tab delimited output/read-only data for botlist #15

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
Simple REST, GET action system for a bot or other tool to read all of the
links on botlist throughing paging system.

Currently almost half a million in links:  Need to limit requests:

1000 entity links per page?

Tab delimited format, something not so easy to fail off of:  '::::' or
something similar.

Original issue reported on code.google.com by berlin.b...@gmail.com on 28 Nov 2007 at 5:25

GoogleCodeExporter commented 9 years ago 
Change '::::' to '||||'

Original comment by berlin.b...@gmail.com on 28 Nov 2007 at 5:26

GoogleCodeExporter commented 9 years ago 
Might also consider a DATE based query system.

Give me all of the links submitted today as opposed to crawling all of the 
links.

Original comment by berlin.b...@gmail.com on 28 Nov 2007 at 5:27

GoogleCodeExporter commented 9 years ago 
Action system is called readrct_pipes

For reading data from the botlist, most recent updates

Original comment by berlin.b...@gmail.com on 28 Nov 2007 at 5:36