spcl / serverless-benchmarks

SeBS: serverless benchmarking suite for automatic performance analysis of FaaS platforms.
https://mcopik.github.io/projects/sebs/
BSD 3-Clause "New" or "Revised" License
149 stars 66 forks source link

googleapiclient.errors.HttpError: <HttpError 403 when requesting https://cloudfunctions.googleapis.com/v1/projects/serverless-benchmarks/locations/europe-west1/functions/function-120_uploader_python_3_7?alt=json returned "Permission 'cloudfunctions.functions.get' denied on resource 'projects/serverless-benchmarks/locations/europe-west1/functions/function-120_uploader_python_3_7' (or resource may not exist)."> #153

Closed jchigu closed 1 year ago

jchigu commented 1 year ago

Describe the bug A clear and concise description of what the bug is. Experiencing the above error after running regression test on GCP

To Reproduce Steps to reproduce the behavior:

  1. Go to '...'
  2. Run the command '....' (python-venv) root@localhost:~/serverless-benchmarks# ./sebs.py benchmark regression test --config config/example.json --deployment gcp --verbose
  3. Scroll down to '....'
  4. See the error

Expected behavior A clear and concise description of what you expected to happen.

It is supposed to deploy the functions and execute them in europe-west1 region

Logs Please provide the output of SeBS commands causing the problem, executed with the flag --verbose. Please use the Markdown fenced code blocks (...) to format error logs. (python-venv) root@localhost:~/serverless-benchmarks# ./sebs.py benchmark regression test --config config/example.json --deployment gcp --verbose [09:55:13.247673] SeBS-c47f Created experiment output at /root/serverless-benchmarks/regression-output Select test test_110.dynamic-html Select test test_120.uploader Select test test_210.thumbnailer Select test test_220.video-processing Select test test_311.compression Select test test_411.image-recognition Select test test_501.graph-pagerank Select test test_502.graph-mst Select test test_503.graph-bfs Select test test_504.dna-visualisation [09:55:14.029674] GCPCredentials-1fee No cached credentials for GCP found, initialize! [09:55:14.037297] GCPResources-f49f No cached resources for GCP found, using user configuration. [09:55:14.037572] GCPConfig-5cf8 Using user-provided config for GCP [09:55:14.036912] GCPCredentials-72a2 No cached credentials for GCP found, initialize! [09:55:14.040669] GCPResources-6b1c No cached resources for GCP found, using user configuration. [09:55:14.040964] GCPConfig-956d Using user-provided config for GCP [09:55:14.036061] GCPCredentials-1c0a No cached credentials for GCP found, initialize! [09:55:14.041753] GCPResources-ab34 No cached resources for GCP found, using user configuration. [09:55:14.042023] GCPConfig-fea9 Using user-provided config for GCP [09:55:14.035140] GCPCredentials-b0fd No cached credentials for GCP found, initialize! [09:55:14.042817] GCPResources-e77a No cached resources for GCP found, using user configuration. [09:55:14.043083] GCPConfig-6d42 Using user-provided config for GCP [09:55:14.036499] GCPCredentials-cf84 No cached credentials for GCP found, initialize! [09:55:14.043846] GCPResources-10a5 No cached resources for GCP found, using user configuration. [09:55:14.044109] GCPConfig-2d33 Using user-provided config for GCP [09:55:14.030156] GCPCredentials-80cc No cached credentials for GCP found, initialize! [09:55:14.044958] GCPResources-6d3c No cached resources for GCP found, using user configuration. [09:55:14.045232] GCPConfig-40b8 Using user-provided config for GCP [09:55:14.035656] GCPCredentials-d712 No cached credentials for GCP found, initialize! [09:55:14.046058] GCPResources-51c3 No cached resources for GCP found, using user configuration. [09:55:14.046333] GCPConfig-6b1a Using user-provided config for GCP [09:55:14.034702] GCPCredentials-5d9f No cached credentials for GCP found, initialize! [09:55:14.047093] GCPResources-4e36 No cached resources for GCP found, using user configuration. [09:55:14.047391] GCPConfig-5ef4 Using user-provided config for GCP [09:55:14.034050] GCPCredentials-18ca No cached credentials for GCP found, initialize! [09:55:14.048196] GCPResources-6fff No cached resources for GCP found, using user configuration. [09:55:14.048483] GCPConfig-3015 Using user-provided config for GCP [09:55:14.049313] GCPCredentials-db95 No cached credentials for GCP found, initialize! [09:55:14.049947] GCPResources-d349 No cached resources for GCP found, using user configuration. [09:55:14.050571] GCPConfig-8286 Using user-provided config for GCP Begin regression test of 110.dynamic-html on gcp, region: europe-west1. Begin regression test of 503.graph-bfs on gcp, region: europe-west1. Begin regression test of 501.graph-pagerank on gcp, region: europe-west1. Begin regression test of 311.compression on gcp, region: europe-west1. Begin regression test of 504.dna-visualisation on gcp, region: europe-west1. [09:56:32.877364] Benchmark-57da Using cached benchmark 504.dna-visualisation at /root/serverless-benchmarks/regression-cache/504.dna-visualisation/gcp/python/3.7/504.dna-visualisation.zip [09:56:32.880022] GCP-bf6e Creating new function! Reason: function function-504_dna_visualisation_python_3_7 not found in cache. [09:56:32.880333] Benchmark-2e0a Using cached benchmark 501.graph-pagerank at /root/serverless-benchmarks/regression-cache/501.graph-pagerank/gcp/python/3.7/501.graph-pagerank.zip [09:56:32.946373] GCP-0adb Creating new function! Reason: function function-501_graph_pagerank_python_3_7 not found in cache. [09:56:32.878852] Benchmark-cc0a Using cached benchmark 110.dynamic-html at /root/serverless-benchmarks/regression-cache/110.dynamic-html/gcp/python/3.7/110.dynamic-html.zip [09:56:32.950286] GCP-a0fc Creating new function! Reason: function function-110_dynamic_html_python_3_7 not found in cache. [09:56:32.875071] Benchmark-fb7a Using cached benchmark 503.graph-bfs at /root/serverless-benchmarks/regression-cache/503.graph-bfs/gcp/python/3.7/503.graph-bfs.zip [09:56:33.007806] GCP-06b9 Creating new function! Reason: function function-503_graph_bfs_python_3_7 not found in cache. [09:56:32.945537] Benchmark-1db2 Using cached benchmark 311.compression at /root/serverless-benchmarks/regression-cache/311.compression/gcp/python/3.7/311.compression.zip [09:56:33.131644] GCP-60b9 Creating new function! Reason: function function-311_compression_python_3_7 not found in cache. Begin regression test of 210.thumbnailer on gcp, region: europe-west1. [09:56:33.703108] Benchmark-8ad1 Using cached benchmark 210.thumbnailer at /root/serverless-benchmarks/regression-cache/210.thumbnailer/gcp/python/3.7/210.thumbnailer.zip [09:56:33.759249] GCP-3779 Creating new function! Reason: function function-210_thumbnailer_python_3_7 not found in cache. Begin regression test of 220.video-processing on gcp, region: europe-west1. [09:56:34.337675] Benchmark-ed39 Using cached benchmark 220.video-processing at /root/serverless-benchmarks/regression-cache/220.video-processing/gcp/python/3.7/220.video-processing.zip [09:56:34.353231] GCP-ab6e Creating new function! Reason: function function-220_video_processing_python_3_7 not found in cache. Begin regression test of 120.uploader on gcp, region: europe-west1. [09:56:34.706772] Benchmark-9995 Using cached benchmark 120.uploader at /root/serverless-benchmarks/regression-cache/120.uploader/gcp/python/3.7/120.uploader.zip [09:56:34.753129] GCP-fd7a Creating new function! Reason: function function-120_uploader_python_3_7 not found in cache. Begin regression test of 502.graph-mst on gcp, region: europe-west1. [09:56:35.589800] Benchmark-f3d7 Using cached benchmark 502.graph-mst at /root/serverless-benchmarks/regression-cache/502.graph-mst/gcp/python/3.7/502.graph-mst.zip [09:56:35.600883] GCP-e3f4 Creating new function! Reason: function function-502_graph_mst_python_3_7 not found in cache. Begin regression test of 411.image-recognition on gcp, region: europe-west1. [09:56:35.872813] Benchmark-ac5a Using cached benchmark 411.image-recognition at /root/serverless-benchmarks/regression-cache/411.image-recognition/gcp/python/3.7/411.image-recognition.zip [09:56:35.873617] GCP-4f3a Creating new function! Reason: function function-411_image_recognition_python_3_7 not found in cache. [10:10:58.686896] GCP-fd7a Uploading function function-120_uploader_python_3_7 code to 120_uploader-0-input-ecba097b-43a2-4f WARNING:googleapiclient.http:Invalid JSON content from response: b'{\n "error": {\n "code": 403,\n "message": "Permission \'cloudfunctions.functions.get\' denied on resource \'projects/serverless-benchmarks/locations/europe-west1/functions/function-120_uploader_python_3_7\' (or resource may not exist).",\n "status": "PERMISSION_DENIED"\n }\n}\n' WARNING:googleapiclient.http:Invalid JSON content from response: b'{\n "error": {\n "code": 403,\n "message": "Permission \'cloudfunctions.functions.create\' denied on resource \'projects/serverless-benchmarks/locations/europe-west1/functions/function-120_uploader_python_3_7\' (or resource may not exist).",\n "status": "PERMISSION_DENIED"\n }\n}\n'


sebs.regression.GCPTestSequence.test_120.uploader: fail sebs.regression.GCPTestSequence.test_120.uploader: Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 213, in create_function get_req.execute() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/googleapiclient/_helpers.py", line 134, in positional_wrapper return wrapped(*args, **kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/googleapiclient/http.py", line 915, in execute raise HttpError(resp, content, uri=self.uri) googleapiclient.errors.HttpError: <HttpError 403 when requesting https://cloudfunctions.googleapis.com/v1/projects/serverless-benchmarks/locations/europe-west1/functions/function-120_uploader_python_3_7?alt=json returned "Permission 'cloudfunctions.functions.get' denied on resource 'projects/serverless-benchmarks/locations/europe-west1/functions/function-120_uploader_python_3_7' (or resource may not exist).">

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 235, in create_function create_req.execute() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/googleapiclient/_helpers.py", line 134, in positional_wrapper return wrapped(*args, **kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/googleapiclient/http.py", line 915, in execute raise HttpError(resp, content, uri=self.uri) googleapiclient.errors.HttpError: <HttpError 403 when requesting https://cloudfunctions.googleapis.com/v1/projects/serverless-benchmarks/locations/europe-west1/functions?alt=json returned "Permission 'cloudfunctions.functions.create' denied on resource 'projects/serverless-benchmarks/locations/europe-west1/functions/function-120_uploader_python_3_7' (or resource may not exist).">



sebs.regression.GCPTestSequence.test_502.graph-mst: fail sebs.regression.GCPTestSequence.test_502.graph-mst: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2071, in _do_upload response = self._do_resumable_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1950, in _do_resumable_upload response = upload.transmit_next_chunk(transport, timeout=timeout) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 496, in transmit_next_chunk response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))



sebs.regression.GCPTestSequence.test_504.dna-visualisation: fail sebs.regression.GCPTestSequence.test_504.dna-visualisation: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2071, in _do_upload response = self._do_resumable_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1950, in _do_resumable_upload response = upload.transmit_next_chunk(transport, timeout=timeout) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 496, in transmit_next_chunk response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))



sebs.regression.GCPTestSequence.test_503.graph-bfs: fail sebs.regression.GCPTestSequence.test_503.graph-bfs: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2071, in _do_upload response = self._do_resumable_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1950, in _do_resumable_upload response = upload.transmit_next_chunk(transport, timeout=timeout) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 496, in transmit_next_chunk response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))



sebs.regression.GCPTestSequence.test_220.video-processing: fail sebs.regression.GCPTestSequence.test_220.video-processing: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2071, in _do_upload response = self._do_resumable_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1950, in _do_resumable_upload response = upload.transmit_next_chunk(transport, timeout=timeout) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 496, in transmit_next_chunk response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))



sebs.regression.GCPTestSequence.test_501.graph-pagerank: fail sebs.regression.GCPTestSequence.test_501.graph-pagerank: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2071, in _do_upload response = self._do_resumable_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1950, in _do_resumable_upload response = upload.transmit_next_chunk(transport, timeout=timeout) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 496, in transmit_next_chunk response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))



sebs.regression.GCPTestSequence.test_210.thumbnailer: fail sebs.regression.GCPTestSequence.test_210.thumbnailer: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2071, in _do_upload response = self._do_resumable_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1950, in _do_resumable_upload response = upload.transmit_next_chunk(transport, timeout=timeout) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 496, in transmit_next_chunk response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))



sebs.regression.GCPTestSequence.test_311.compression: fail sebs.regression.GCPTestSequence.test_311.compression: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2056, in _do_upload response = self._do_multipart_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1658, in _do_multipart_upload response = upload.transmit( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 139, in transmit response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))



sebs.regression.GCPTestSequence.test_411.image-recognition: fail sebs.regression.GCPTestSequence.test_411.image-recognition: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2071, in _do_upload response = self._do_resumable_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1950, in _do_resumable_upload response = upload.transmit_next_chunk(transport, timeout=timeout) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 496, in transmit_next_chunk response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))



sebs.regression.GCPTestSequence.test_110.dynamic-html: fail sebs.regression.GCPTestSequence.test_110.dynamic-html: Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) socket.timeout: The write operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 495, in send resp = conn.urlopen( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen retries = retries.increment( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen httplib_response = self._make_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request conn.request(method, url, **httplib_request_kw) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1256, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1302, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1050, in _send_output self.send(chunk) File "/usr/lib/python3.8/http/client.py", line 972, in send self.sock.sendall(data) File "/usr/lib/python3.8/ssl.py", line 1204, in sendall v = self.send(byte_view[count:]) File "/usr/lib/python3.8/ssl.py", line 1173, in send return self._sslobj.write(data) urllib3.exceptions.ProtocolError: ('Connection aborted.', timeout('The write operation timed out'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/serverless-benchmarks/sebs/regression.py", line 50, in test func = deployment_client.get_function( File "/root/serverless-benchmarks/sebs/faas/system.py", line 174, in get_function function = self.create_function(code_package, func_name) File "/root/serverless-benchmarks/sebs/gcp/gcp.py", line 206, in create_function storage_client.upload(code_bucket, package, code_package_name) File "/root/serverless-benchmarks/sebs/gcp/storage.py", line 66, in upload blob.upload_from_filename(filepath) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2338, in upload_from_filename self.upload_from_file( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2224, in upload_from_file created_json = self._do_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 2056, in _do_upload response = self._do_multipart_upload( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/cloud/storage/blob.py", line 1658, in _do_multipart_upload response = upload.transmit( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/upload.py", line 139, in transmit response = _request_helpers.http_request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/requests/_request_helpers.py", line 136, in http_request return _helpers.wait_and_retry(func, RequestsMixin._get_status_code, retry_strategy) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 188, in wait_and_retry raise error File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/resumable_media/_helpers.py", line 177, in wait_and_retry response = func() File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/google/auth/transport/requests.py", line 480, in request response = super(AuthorizedSession, self).request( File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, kwargs) File "/root/serverless-benchmarks/python-venv/lib/python3.8/site-packages/requests/adapters.py", line 553, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', timeout('The write operation timed out'))


Succesfully executed 0 out of 10 functions Failures when executing 10 out of 10 functions

System (please complete the following information):

Additional context Add any other context about the problem here.

mcopik commented 1 year ago

This is a duplicate of #152