mcopik
commented
1 year ago @jchigu I cannot reproduce the issue. Please follow the template for bug reports (it appears automatically when you open a new issue), provide all necessary information, and format logging outputs correctly (use Markdown's fenced code block). Did you modify SeBS source code at any point?
Once you provide the requested information, I will be happy to reopen the issue and investigate.
(python-venv) root@localhost:~/serverless-benchmarks# ./sebs.py benchmark invoke 220.video-processing test --config config/example.json --deployment aws --verbose --update-code --update-storage [09:24:59.014374] SeBS-011c Created experiment output at /root/serverless-benchmarks [09:24:59.933825] AWS.Credentials-7694 Using cached credentials for AWS [09:24:59.939169] AWS.Resources-6016 Using cached resources for AWS [09:24:59.939449] AWS.Config-ce59 Using cached config for AWS [09:25:00.193379] Benchmark-898e Building benchmark 220.video-processing. Reason: cached code package is not up to date/build enforced. [09:26:03.292638] Benchmark-898e chmod: cannot access 'ffmpeg/ffmpeg': No such file or directory
[09:26:03.331543] Benchmark-898e Docker build of benchmark dependencies in container of image spcleth/serverless-benchmarks:build.aws.python.3.7 [09:26:03.333248] Benchmark-898e Docker mount of benchmark code from path /root/serverless-benchmarks/220.video-processing_code/python/3.7 [09:26:36.525156] AWS-cb47 Created /root/serverless-benchmarks/220.video-processing_code/python/3.7/220.video-processing.zip archive [09:26:36.533761] AWS-cb47 Zip archive size 29.734439 MB [09:26:36.540703] Benchmark-898e Created code package (source hash: d89739cdee4bf5eea81cf322c6e5886a), for run on aws with python:3.7 [09:26:37.136511] AWS-cb47 Creating new function! Reason: function 220_video_processing_python_3_7 not found in cache. [09:26:37.917523] AWS-cb47 Function 220_video_processing_python_3_7 exists on AWS, retrieve configuration. ERROR:root:Connection was closed before we received a valid response from endpoint URL: "https://lambda.us-east-1.amazonaws.com/2015-03-31/functions/220_video_processing_python_3_7/code". Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/awsrequest.py", line 94, in _send_request rval = super()._send_request( File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/awsrequest.py", line 123, in _send_output self.send(msg) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/awsrequest.py", line 218, in send return super().send(str) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/httpsession.py", line 455, in send urllib_response = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 525, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/awsrequest.py", line 94, in _send_request rval = super()._send_request( File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/awsrequest.py", line 123, in _send_output self.send(msg) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/awsrequest.py", line 218, in send return super().send(str) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "./sebs.py", line 30, in call return self.main(args, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/click/core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/click/core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, ctx.params) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/click/core.py", line 760, in invoke return __callback(args, kwargs) File "./sebs.py", line 72, in wrapper return func(*args, *kwargs) File "./sebs.py", line 97, in wrapper return func(args, kwargs) File "./sebs.py", line 233, in invoke func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/aws/aws.py", line 190, in create_function self.update_function(lambda_function, code_package) File "/root/serverless-benchmarks/sebs/aws/aws.py", line 274, in update_function self.client.update_function_code(FunctionName=name, ZipFile=code_body.read()) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/client.py", line 530, in _api_call return self._make_api_call(operation_name, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/client.py", line 943, in _make_api_call http, parsed_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/client.py", line 966, in _make_request return self._endpoint.make_request(operation_model, request_dict) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/endpoint.py", line 119, in make_request return self._send_request(request_dict, operation_model) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/endpoint.py", line 202, in _send_request while self._needs_retry( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/endpoint.py", line 354, in _needs_retry responses = self._event_emitter.emit( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/hooks.py", line 412, in emit return self._emitter.emit(aliased_event_name, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/hooks.py", line 256, in emit return self._emit(event_name, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/hooks.py", line 239, in _emit response = handler(kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/retryhandler.py", line 207, in call if self._checker(**checker_kwargs): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/retryhandler.py", line 284, in call should_retry = self._should_retry( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/retryhandler.py", line 320, in _should_retry return self._checker(attempt_number, response, caught_exception) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/retryhandler.py", line 363, in call checker_response = checker( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/retryhandler.py", line 247, in call return self._check_caught_exception( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/retryhandler.py", line 416, in _check_caught_exception raise caught_exception File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/endpoint.py", line 281, in _do_get_response http_response = self._send(request) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/endpoint.py", line 377, in _send return self.http_session.send(request) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/botocore/httpsession.py", line 494, in send raise ConnectionClosedError( botocore.exceptions.ConnectionClosedError: Connection was closed before we received a valid response from endpoint URL: "https://lambda.us-east-1.amazonaws.com/2015-03-31/functions/220_video_processing_python_3_7/code".