liuslnlp / ProxyPool

跨语言IP代理池,Python实现。
Apache License 2.0
355 stars 121 forks source link

运行爬虫时是可以获得代理的,但是之后会报错,搜索了一下无法解决,特来请教 #4

Open Alex-ZhaoR opened 7 years ago

Alex-ZhaoR commented 7 years ago

运行爬虫时是可以获得代理的,但是之后会报错,搜索了一下无法解决,特来请教 Expire Check Process is working.. PoolAdder is working

['58.222.254.11:3128', '61.185.219.126:3128', '218.247.161.37:80', '61.172.249.96:80', '211.155.234.99:80', '218.75.100.114:8080''] Usability tester is working... File "C:\Users\strivezr\AppData\Local\Programs\Python\Python36\lib\selectors.py", line 323, in select r, w, _ = self._select(self._readers, self._writers, [], timeout) File "C:\Users\strivezr\AppData\Local\Programs\Python\Python36\lib\selectors.py", line 314, in _select r, w, x = select.select(r, w, w, timeout) ValueError: too many file descriptors in select()

carlos2cheng commented 7 years ago

解决方案参考: https://blog.magentaize.net/fix-python-too-many-file-descriptors-in-select-in-windows/ 建议直接开linux跑,而不是去解决这个问题。