请问如果个人编写其他爬虫，steam的请求需要间隔多久？和Buff一样吗？

puppylpg / oddish

Crawl csgo skin info from `buff.163.com` and steam, then find the most suitable one to buy from the former and to sell to the latter.

GNU General Public License v3.0

321 stars 80 forks source link

Closed Frankcsc closed 3 years ago

Frankcsc commented 3 years ago

RT 请问如果个人编写其他爬虫，steam的请求需要间隔多久？也可联系邮箱 yulecsc@qq.com 感谢！

puppylpg commented 3 years ago

steam貌似没有爬取间隔限制，后来的oddish用异步io爬steam，几乎无间隔，steam也没有采取什么措施，估计服务器比较强，对这种小批量的爬不在乎