jeff2go / 1688-Crawler

1688 Crawler based on Flask
29 stars 8 forks source link

服务器返回500 #1

Closed nuomi closed 4 years ago

nuomi commented 4 years ago

hi,

感谢项目代码!

我在运行时遇到问题,在调用 /crawlers/products?url= 几次之后,1688服务器对新请求返回500,无法继续抓取。

请问有解决办法吗?

jeff2go commented 4 years ago

要想一直能爬取,需要自己研究下反爬虫。