search

oracle / oci-python-sdk

Oracle Cloud Infrastructure SDK for Python
https://cloud.oracle.com/cloud-infrastructure
Other
374 stars 273 forks source link

MissingHeaderBodySeparatorDefect when uploading items to OSS #622

Open mflong23 opened 4 months ago

mflong23 commented 4 months ago

When uploading files to OSS, I randomly (~1000 items in) experience this error after I run 

with open(file_path, 'rb') as f:
                obj_data = f.read()
                try:
                      response = oci_client.put_object(
                                    OSS_NAMESPACE, 
                                    OSS_BUCKET_NAME,
                                    oss_object_name,  # object name 
                                    obj_data, # object body (bytes)
                                )
                       if response.status != 200:
                              msg = f'WARNING: {oss_object_name} upload resulted in status {response.status}. {response.data}'
                              logging.log(logging.WARN, msg)
                              print(msg)
                        else:
                              msg = f'SUCCESS! {oss_object_name} uploaded'
                              logging.log(logging.INFO, msg)
                              print(msg)
                except oci.exceptions.ServiceError as e:
                    # Handling OCI specific exceptions
                    msg = f'ERROR: {oss_object_name} upload failed with ServiceError. {e.status} {e.message}'
                    logging.error(msg)
                    print(msg)
                except Exception as e:
                    msg = f'ERROR: {oss_object_name} upload failed. {e}'
                    logging.log(logging.ERROR, msg)
                    print(msg)

Here's the traceback:

2024-02-19 20:09:39,991:WARNING:Failed to parse headers (url=https://objectstorage.ap-osaka-1.oraclecloud.com:443/n/ax2tjlcefnht/b/laion2B-en-aesthetic/o/000000401/000000401.txt): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 07f8f92b-fd96-49ec-b9db-1b927e144116\r\nlast-modified: Mon, 19 Feb 2024 20:09:39 GMT\r\nopc-content-md5: tMGI50PK84P9//D2pQ8evQ==\r\nversion-id: 04303300-a3ec-4fdb-a2eb-58cd65effb06\r\nContent-Length: 0\r\ndate: Mon, 19 Feb 2024 20:09:39 GMT\r\nopc-request-id: kix-1:BaX2PWrWLWStJYPKMWmC_TRLmcJaINqwJQey95jbJrG80yzz4rVgEBGGUeet-gvk\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: *\r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,last-modified,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,version-id,x-api-id,x-content-type-options\r\n\r\n'
Traceback (most recent call last):
  File "/home/Mindy/.cache/pypoetry/virtualenvs/t2i-adapter-3QVI5i9t-py3.10/lib/python3.10/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request
    assert_header_parsing(httplib_response.msg)
  File "/home/Mindy/.cache/pypoetry/virtualenvs/t2i-adapter-3QVI5i9t-py3.10/lib/python3.10/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing
    raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data)
oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 07f8f92b-fd96-49ec-b9db-1b927e144116\r\nlast-modified: Mon, 19 Feb 2024 20:09:39 GMT\r\nopc-content-md5: tMGI50PK84P9//D2pQ8evQ==\r\nversion-id: 04303300-a3ec-4fdb-a2eb-58cd65effb06\r\nContent-Length: 0\r\ndate: Mon, 19 Feb 2024 20:09:39 GMT\r\nopc-request-id: kix-1:BaX2PWrWLWStJYPKMWmC_TRLmcJaINqwJQey95jbJrG80yzz4rVgEBGGUeet-gvk\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: *\r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,last-modified,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,version-id,x-api-id,x-content-type-options\r\n\r\n'

Even after adding try...except, I can't catch the exception and my code hangs. put_object worked fine for me two weeks ago when I uploaded hundreds of thousands of items.

jyotisaini commented 4 months ago

Hi @mflong23 what version of python SDK are you using? you mentioned that the code was working before - Can you the share the version of SDK you used that time ?

mflong23 commented 4 months ago

Originally I was using 2.122.0. Then I checked my previous code that was using 2.121.0. I changed reinstalled my SDK as 2.121.0 but it still wasn't working

On Wed, Feb 21, 2024 at 9:18 AM Jyoti Saini @.***> wrote:

Hi @mflong23 https://github.com/mflong23 what version of python SDK are you using? you mentioned that the code was working before - Can you the share the version of SDK you used that time ?

— Reply to this email directly, view it on GitHub https://github.com/oracle/oci-python-sdk/issues/622#issuecomment-1957367437, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAWBOHSV577Y66ITBJUZGITYUYT4TAVCNFSM6AAAAABDQAMWNCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJXGM3DONBTG4 . You are receiving this because you were mentioned.Message ID: @.***>

jyotisaini commented 4 months ago

Hi @mflong23 what is the size of the objects that you are uploading ? We have had a known issue when you try to upload a bigger size files and service returned 413 response because the request entity was larger than limits defined by server and then subsequent calls failed with MissingHeaderBodySeparatorDefect. I would suggest using upload manager and see if you still run in to the issue.

mflong23 commented 4 months ago

I was uploading small images (<10kB). I was using UploadManager originally, which gave me the error, so I switched to object_storage_client.put_object, which still gave me the error. I ended up using s5cmd instead.

On Wed, Feb 21, 2024 at 11:10 PM Jyoti Saini @.***> wrote:

Hi @mflong23 https://github.com/mflong23 what is the size of the objects that you are uploading ? We have had a known issue when you try to upload a bigger size files and service returned 413 response because the request entity was larger than limits defined by server and then subsequent calls failed with MissingHeaderBodySeparatorDefect. I would suggest using upload manager and see if you still run in to the issue.

— Reply to this email directly, view it on GitHub https://github.com/oracle/oci-python-sdk/issues/622#issuecomment-1958834413, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAWBOHVWNHX32AUVNIWSOJTYU3VPXAVCNFSM6AAAAABDQAMWNCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJYHAZTINBRGM . You are receiving this because you were mentioned.Message ID: @.***>

glammar commented 2 months ago

Happens with oci cli (latest version as well as ol7 provided rpm) has well.
traceback (most recent call last):

  File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request
    assert_header_parsing(httplib_response.msg)
  File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing
    raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data)
oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 3b1cf85a-4ff1-4aaf-ab13-3b675c2772b5\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:28:57 GMT\r\nopc-request-id: phx-1:v2cB36hcMDKnx_xexSw-TL6qO37fHwuv36hhY3VFEGRxuWOuGvXyTD3pzDkc9GMq\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: *\r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n'
MultipartUploadError: MultipartUploadError exception has occured. Client Version: Oracle-PythonSDK/2.126.1, OS Version: Linux-5.4.17-2136.329.3.1.el7uek.x86_64-x86_64-with-oracle-7.9, See https://docs.oracle.com/iaas/Content/API/Concepts/sdk_troubleshooting.htm for common issues and steps to resolve them. If you need to contact support, or file a GitHub issue, please include this full error message.

Full trace output: WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=67): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 9252655e-dc09-499c-8561-aa8c14487a05\r\nopc-content-md5: 921UcHqpXx7IplHNKWBiFg==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:20:54 GMT\r\nopc-request-id: phx-1:WyGTr9tlak3oG3OKYU4Igw3RZ5XKI2HCI1olNO3gx2TZllXAesJyWTDjhHPdB6KK\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 9252655e-dc09-499c-8561-aa8c14487a05\r\nopc-content-md5: 921UcHqpXx7IplHNKWBiFg==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:20:54 GMT\r\nopc-request-id: phx-1:WyGTr9tlak3oG3OKYU4Igw3RZ5XKI2HCI1olNO3gx2TZllXAesJyWTDjhHPdB6KK\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=67): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: f9d4cd5c-621b-4c19-8952-59cc9fc3815e\r\nopc-content-md5: 921UcHqpXx7IplHNKWBiFg==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:21:54 GMT\r\nopc-request-id: phx-1:qbfx6w-hfifmW--OF8rqZ_t4rw7qEsHQgmwWWf3-xMoPw6KVnIg6fGwWjJIWoTjw\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: f9d4cd5c-621b-4c19-8952-59cc9fc3815e\r\nopc-content-md5: 921UcHqpXx7IplHNKWBiFg==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:21:54 GMT\r\nopc-request-id: phx-1:qbfx6w-hfifmW--OF8rqZ_t4rw7qEsHQgmwWWf3-xMoPw6KVnIg6fGwWjJIWoTjw\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=67): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: ed563d4b-8a59-4851-a778-19dbbb1ca97c\r\nopc-content-md5: 921UcHqpXx7IplHNKWBiFg==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:22:55 GMT\r\nopc-request-id: phx-1:oLPBI736JI541QGILbEJLvT1DizqtGfnmZAtSbpfMWhba-Luh1Yb1quoT-XSLoV9\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: ed563d4b-8a59-4851-a778-19dbbb1ca97c\r\nopc-content-md5: 921UcHqpXx7IplHNKWBiFg==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:22:55 GMT\r\nopc-request-id: phx-1:oLPBI736JI541QGILbEJLvT1DizqtGfnmZAtSbpfMWhba-Luh1Yb1quoT-XSLoV9\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=67): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 535e0e01-fcb1-4d0f-a1a3-5abfe209a650\r\nopc-content-md5: 921UcHqpXx7IplHNKWBiFg==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:23:55 GMT\r\nopc-request-id: phx-1:JIgkFyjNSUwrLsCDdWfpSVyr1QYbI13vUxN-eNAfAZrNt1hCmZBLvrMyTVwQmJev\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 535e0e01-fcb1-4d0f-a1a3-5abfe209a650\r\nopc-content-md5: 921UcHqpXx7IplHNKWBiFg==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:23:55 GMT\r\nopc-request-id: phx-1:JIgkFyjNSUwrLsCDdWfpSVyr1QYbI13vUxN-eNAfAZrNt1hCmZBLvrMyTVwQmJev\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=68): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 10bf3630-1a7d-49ad-bc10-1e93aa41d37c\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:24:55 GMT\r\nopc-request-id: phx-1:5HcP-aiXDAbmRzF-ulhD-3OVyz1R8gNcZCS48kLTzB0tUifdJ8353wlvhepVqEwF\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 10bf3630-1a7d-49ad-bc10-1e93aa41d37c\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:24:55 GMT\r\nopc-request-id: phx-1:5HcP-aiXDAbmRzF-ulhD-3OVyz1R8gNcZCS48kLTzB0tUifdJ8353wlvhepVqEwF\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=68): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: cb08a448-a2ce-4e5f-a355-c140bba94c7b\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:25:56 GMT\r\nopc-request-id: phx-1:MSnz1pr4Zkmp0HWydQjDWWDJzcaZNg8gasC-WLRMXoPsFmnp1quV-Np9crk6HU17\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: cb08a448-a2ce-4e5f-a355-c140bba94c7b\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:25:56 GMT\r\nopc-request-id: phx-1:MSnz1pr4Zkmp0HWydQjDWWDJzcaZNg8gasC-WLRMXoPsFmnp1quV-Np9crk6HU17\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=68): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 177d1647-7c41-4dca-a9f6-5d5da5cd848a\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:26:56 GMT\r\nopc-request-id: phx-1:ooybF8-Odr4fDgOsp1FFRStmjBlFs2Bv-0rzAjKB7bPDZOXAf59hiCsyP6Mr-oCt\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 177d1647-7c41-4dca-a9f6-5d5da5cd848a\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:26:56 GMT\r\nopc-request-id: phx-1:ooybF8-Odr4fDgOsp1FFRStmjBlFs2Bv-0rzAjKB7bPDZOXAf59hiCsyP6Mr-oCt\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=68): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: b75b0e7c-eeda-4140-bf1f-2c40d21c6328\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:27:56 GMT\r\nopc-request-id: phx-1:1iBv3AuE_8sUfDdEQiEOmPJA6i4g-6yvhWYFL8RADWPEb7UxEvK9-8-J07kMObkt\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: b75b0e7c-eeda-4140-bf1f-2c40d21c6328\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:27:56 GMT\r\nopc-request-id: phx-1:1iBv3AuE_8sUfDdEQiEOmPJA6i4g-6yvhWYFL8RADWPEb7UxEvK9-8-J07kMObkt\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' WARNING:oci._vendor.urllib3.connectionpool:Failed to parse headers (url=https://objectstorage.us-phoenix-1.oraclecloud.com:443/n/oraclebigdatadb/b/store_sales_10PB_textc/u/ss_00007_bd.gz?uploadId=bab28480-d0ef-f232-5b9d-0c31d5b00746&uploadPartNum=68): [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 3b1cf85a-4ff1-4aaf-ab13-3b675c2772b5\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:28:57 GMT\r\nopc-request-id: phx-1:v2cB36hcMDKnx_xexSw-TL6qO37fHwuv36hhY3VFEGRxuWOuGvXyTD3pzDkc9GMq\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' Traceback (most recent call last): File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/connectionpool.py", line 474, in _make_request assert_header_parsing(httplib_response.msg) File "/home/opc/lib/oracle-cli/lib64/python3.6/site-packages/oci/_vendor/urllib3/util/response.py", line 96, in assert_header_parsing raise HeaderParsingError(defects=defects, unparsed_data=unparsed_data) oci._vendor.urllib3.exceptions.HeaderParsingError: [MissingHeaderBodySeparatorDefect()], unparsed data: 'HTTP/1.1 200 OK\r\netag: 3b1cf85a-4ff1-4aaf-ab13-3b675c2772b5\r\nopc-content-md5: +xkuI+9bRNYjYcMzJD8ePw==\r\nContent-Length: 0\r\ndate: Wed, 01 May 2024 21:28:57 GMT\r\nopc-request-id: phx-1:v2cB36hcMDKnx_xexSw-TL6qO37fHwuv36hhY3VFEGRxuWOuGvXyTD3pzDkc9GMq\r\nx-api-id: native\r\nx-content-type-options: nosniff\r\nstrict-transport-security: max-age=31536000; includeSubDomains\r\naccess-control-allow-origin: \r\naccess-control-allow-methods: POST,PUT,GET,HEAD,DELETE,OPTIONS\r\naccess-control-allow-credentials: true\r\naccess-control-expose-headers: access-control-allow-credentials,access-control-allow-methods,access-control-allow-origin,content-length,date,etag,opc-client-info,opc-content-md5,opc-request-id,strict-transport-security,x-api-id,x-content-type-options\r\n\r\n' MultipartUploadError: MultipartUploadError exception has occured. Client Version: Oracle-PythonSDK/2.126.1, OS Version: Linux-5.4.17-2136.329.3.1.el7uek.x86_64-x86_64-with-oracle-7.9, See https://docs.oracle.com/iaas/Content/API/Concepts/sdk_troubleshooting.htm for common issues and steps to resolve them. If you need to contact support, or file a GitHub issue, please include this full error message.

giharish commented 4 days ago

We are also facing the same issue and it is random. Any solution yet for this one