search

qfnusjr / qfnusjr.github.io

0 stars 0 forks source link

scrapy爬虫出现Forbidden by robots.txt | 兮兮_sunshine #1

Open qfnusjr opened 6 years ago

qfnusjr commented 6 years ago

http://qfnusjr.com/2017/12/19/scrapy%E7%88%AC%E8%99%AB%E5%87%BA%E7%8E%B0Forbidden-by-robots-txt/#more

qfnusjr commented 6 years ago

测试评论

yaoyaoru commented 6 years ago

这篇文章有意思！