search

dfm / osrc

The Open Source Report Card
http://osrc.dfm.io
MIT License
1.03k stars 136 forks source link

Too many open connections , can't download data #30

Closed divanvisagie closed 11 years ago

divanvisagie commented 11 years ago

ConnectionError: HTTPConnectionPool(host='data.githubarchive.org', port=80): Max retries exceeded with url: /2011-02-12-31.json.gz (Caused by <class 'socket.error'>: [Errno 24] Too many open files) <Greenlet at 0x107fbcaf0: fetch(2011, 2, 12, 31)> failed with ConnectionError

Traceback (most recent call last): File "/Library/Python/2.7/site-packages/gevent/greenlet.py", line 390, in run File "fetch.py", line 40, in fetch File "/Library/Python/2.7/site-packages/requests/api.py", line 55, in get File "/Library/Python/2.7/site-packages/requests/api.py", line 44, in request File "/Library/Python/2.7/site-packages/requests/sessions.py", line 335, in request File "/Library/Python/2.7/site-packages/requests/sessions.py", line 438, in send File "/Library/Python/2.7/site-packages/requests/adapters.py", line 327, in send ConnectionError: HTTPConnectionPool(host='data.githubarchive.org', port=80): Max retries exceeded with url: /2011-02-16-31.json.gz (Caused by <class 'socket.error'>: [Errno 24] Too many open files) <Greenlet at 0x107fbcd70: fetch(2011, 2, 16, 31)> failed with ConnectionError

dfm commented 11 years ago

Seriously? You don't even bother to write a sentence about what's happening or try to ask a question? Seriously?

Come on.

divanvisagie commented 11 years ago

"Too many open connections , can't download data" - seems pretty descriptive...

You have a lot of data coming down when using fetch.py and its throwing this error.

Please try not be so dismissive... eg: https://github.com/dfm/osrc/issues/29 and now this.