When submitting a new docker image for the 1st time I often get the following error:
$ evalai push objectnet_dmayo:v3--phase objectnet-objectnet-express-293
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/urllib3/response.py", line 362, in _error_catcher
yield
File "/usr/local/lib/python3.6/dist-packages/urllib3/response.py", line 444, in read
data = self._fp.read(amt)
File "/usr/lib/python3.6/http/client.py", line 459, in read
n = self.readinto(b)
File "/usr/lib/python3.6/http/client.py", line 493, in readinto
return self._readinto_chunked(b)
File "/usr/lib/python3.6/http/client.py", line 588, in _readinto_chunked
chunk_left = self._get_chunk_left()
File "/usr/lib/python3.6/http/client.py", line 556, in _get_chunk_left
chunk_left = self._read_next_chunk_size()
File "/usr/lib/python3.6/http/client.py", line 516, in _read_next_chunk_size
line = self.fp.readline(_MAXLINE + 1)
File "/usr/lib/python3.6/socket.py", line 586, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/evalai", line 11, in <module>
sys.exit(main())
File "/usr/lib/python3/dist-packages/click/core.py", line 722, in __call__
return self.main(*args, **kwargs)
File "/usr/lib/python3/dist-packages/click/core.py", line 697, in main
rv = self.invoke(ctx)
File "/usr/lib/python3/dist-packages/click/core.py", line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3/dist-packages/click/core.py", line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python3/dist-packages/click/core.py", line 535, in invoke
return callback(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/evalai/submissions.py", line 172, in push
repository_uri, tag, stream=True, decode=True
File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 324, in _stream_helper
for chunk in json_stream(self._stream_helper(response, False)):
File "/usr/local/lib/python3.6/dist-packages/docker/utils/json_stream.py", line 66, in split_buffer
for data in stream_as_text(stream):
File "/usr/local/lib/python3.6/dist-packages/docker/utils/json_stream.py", line 22, in stream_as_text
for data in stream:
File "/usr/local/lib/python3.6/dist-packages/docker/api/client.py", line 330, in _stream_helper
data = reader.read(1)
File "/usr/local/lib/python3.6/dist-packages/urllib3/response.py", line 461, in read
raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__
self.gen.throw(type, value, traceback)
File "/usr/local/lib/python3.6/dist-packages/urllib3/response.py", line 367, in _error_catcher
raise ReadTimeoutError(self._pool, None, 'Read timed out.')
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out.
Repeating the push immediately after is usually success - presumably because most of the docker layers have been cached at the server.
Things already tried and didn't work-
Maybe setting DOCKER_CLIENT_TIMEOUT will help: docker/compose#6837
When submitting a new docker image for the 1st time I often get the following error:
Repeating the push immediately after is usually success - presumably because most of the docker layers have been cached at the server.
Things already tried and didn't work-