search

SpiderClub / weibospider

:zap: A distributed crawler for weibo, building with celery and requests.
MIT License
4.81k stars 1.21k forks source link

fix crawl mode: accurate，修复“展开全文”404 获取不到内容的问题 #173

Closed OneCodeMonkey closed 5 years ago

OneCodeMonkey commented 5 years ago

老的接口 404，换这个接口爬 “展开全文” 没问题。 但是这个接口，要登陆才能用。所以这里 level = 2. 老的是 level =0 为了让未登录也能爬，由于老接口不能用所以设 0 还是2 没有区别。所以这里直接用 level = 2