errorbucket / error-bucket

One Bucket to rule them all
6 stars 0 forks source link

Drop errors from bot/spider/crawler. Close #64 #65

Closed amio closed 9 years ago

hax commented 9 years ago

最好能选择,比如也许也要看baidu spider遇到什么问题(为了seo迎合它)。 当然默认视图上应该滤掉。

amio commented 9 years ago

恩,考虑把过滤掉的数据存到另一个地方去, 需要的话拿出来查查