search

akiradeveloper / akashic-storage

Filey system backed S3-compatible storage in Scala/Akka-Http
Apache License 2.0
22 stars 2 forks source link

ERROR: s3tests.functional.test_s3.test_atomic_write_8mb #19

Closed akiradeveloper closed 8 years ago

akiradeveloper commented 8 years ago

ERROR: s3tests.functional.test_s3.test_atomic_write_1mb

Traceback (most recent call last): File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(_self.arg) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/s3tests/functional/test_s3.py", line 5512, in test_atomic_write_1mb _test_atomic_write(1024_1024) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/s3tests/functional/test_s3.py", line 5490, in _test_atomic_write key.set_contents_from_file(fp_a) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 1293, in set_contents_from_file chunked_transfer=chunked_transfer, size=size) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 750, in send_file chunked_transfer=chunked_transfer, size=size) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 951, in _send_file_internal query_args=query_args File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/connection.py", line 665, in make_request retry_handler=retry_handler File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/connection.py", line 1071, in make_request retry_handler=retry_handler) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/connection.py", line 940, in _mexe request.body, request.headers) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 882, in sender if not self.should_retry(response, chunked_transfer): File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 983, in should_retry '%s vs. %s' % (self.etag, self.md5)) S3DataError: BotoClientError: ETag from S3 did not match computed MD5. e6065c4aa2ab1603008fc18410f579d4 vs. e6065c4aa2ab1603008fc18410f579d4 -------------------- >> begin captured logging << -------------------- boto: DEBUG: path=/hoge-36kp5mui93t3h41zet8saher-288/ boto: DEBUG: auth_path=/hoge-36kp5mui93t3h41zet8saher-288/ boto: DEBUG: Method: PUT boto: DEBUG: Path: /hoge-36kp5mui93t3h41zet8saher-288/ boto: DEBUG: Data: boto: DEBUG: Headers: {} boto: DEBUG: Host: 127.0.0.1:10946 boto: DEBUG: Port: 10946 boto: DEBUG: Params: {} boto: DEBUG: establishing HTTP connection: kwargs={'port': 10946, 'timeout': 70} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT

Sat, 23 Jan 2016 06:12:31 GMT /hoge-36kp5mui93t3h41zet8saher-288/ boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:yWo0TuRiROZUMHgsQI91ygsFVeA= boto: DEBUG: Final headers: {'Date': 'Sat, 23 Jan 2016 06:12:31 GMT', 'Content-Length': '0', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:yWo0TuRiROZUMHgsQI91ygsFVeA=', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic'} boto: DEBUG: Response headers: [('content-length', '0'), ('x-amz-request-id', '6G5FJqcKoAunOuEd'), ('content-type', 'text/plain;charset=utf-8')] boto: DEBUG: path=/hoge-36kp5mui93t3h41zet8saher-288/testobj boto: DEBUG: auth_path=/hoge-36kp5mui93t3h41zet8saher-288/testobj boto: DEBUG: Method: PUT boto: DEBUG: Path: /hoge-36kp5mui93t3h41zet8saher-288/testobj boto: DEBUG: Data: boto: DEBUG: Headers: {'Content-Length': '1048576', 'Content-MD5': u'5gZcSqKrFgMAj8GEEPV51A==', 'Content-Type': 'application/octet-stream', 'Expect': '100-Continue', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic'} boto: DEBUG: Host: 127.0.0.1:10946 boto: DEBUG: Port: 10946 boto: DEBUG: Params: {} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT 5gZcSqKrFgMAj8GEEPV51A== application/octet-stream Sat, 23 Jan 2016 06:12:31 GMT /hoge-36kp5mui93t3h41zet8saher-288/testobj boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:Pk0y0me6IjtccPUz4WjubpCkSQs= boto: DEBUG: Final headers: {'Content-Length': '1048576', 'Content-MD5': '5gZcSqKrFgMAj8GEEPV51A==', 'Expect': '100-Continue', 'Date': 'Sat, 23 Jan 2016 06:12:31 GMT', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:Pk0y0me6IjtccPUz4WjubpCkSQs='} --------------------- >> end captured logging << ---------------------

akiradeveloper commented 8 years ago

ERROR: s3tests.functional.test_s3.test_atomic_write_8mb

Traceback (most recent call last): File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(_self.arg) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/s3tests/functional/test_s3.py", line 5526, in test_atomic_write_8mb _test_atomic_write(1024_1024*8) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/s3tests/functional/test_s3.py", line 5490, in _test_atomic_write key.set_contents_from_file(fp_a) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 1293, in set_contents_from_file chunked_transfer=chunked_transfer, size=size) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 750, in send_file chunked_transfer=chunked_transfer, size=size) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 951, in _send_file_internal query_args=query_args File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/s3/connection.py", line 665, in make_request retry_handler=retry_handler File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/connection.py", line 1071, in make_request retry_handler=retry_handler) File "/home/travis/build/akiradeveloper/akashic-storage/s3-tests/s3-tests-clone/virtualenv/local/lib/python2.7/site-packages/boto/connection.py", line 1030, in _mexe raise ex error: [Errno 104] Connection reset by peer -------------------- >> begin captured logging << -------------------- boto: DEBUG: path=/hoge-31vc4xw9yanbvc4liz7qbtnr-290/ boto: DEBUG: auth_path=/hoge-31vc4xw9yanbvc4liz7qbtnr-290/ boto: DEBUG: Method: PUT boto: DEBUG: Path: /hoge-31vc4xw9yanbvc4liz7qbtnr-290/ boto: DEBUG: Data: boto: DEBUG: Headers: {} boto: DEBUG: Host: 127.0.0.1:10946 boto: DEBUG: Port: 10946 boto: DEBUG: Params: {} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT

Sun, 24 Jan 2016 16:47:06 GMT /hoge-31vc4xw9yanbvc4liz7qbtnr-290/ boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:M9cHAd4mRZRUFT7sszsTOnbiXGk= boto: DEBUG: Final headers: {'Date': 'Sun, 24 Jan 2016 16:47:06 GMT', 'Content-Length': '0', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:M9cHAd4mRZRUFT7sszsTOnbiXGk=', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic'} boto: DEBUG: Response headers: [('content-length', '0'), ('x-amz-request-id', 'No2QRsTtXuyXHwyA'), ('content-type', 'text/plain;charset=utf-8')] boto: DEBUG: path=/hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: auth_path=/hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Method: PUT boto: DEBUG: Path: /hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Data: boto: DEBUG: Headers: {'Content-Length': '8388608', 'Content-MD5': u'UYiGy3DBwRnJmtG7tYZeeg==', 'Content-Type': 'application/octet-stream', 'Expect': '100-Continue', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic'} boto: DEBUG: Host: 127.0.0.1:10946 boto: DEBUG: Port: 10946 boto: DEBUG: Params: {} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT UYiGy3DBwRnJmtG7tYZeeg== application/octet-stream Sun, 24 Jan 2016 16:47:06 GMT /hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8= boto: DEBUG: Final headers: {'Content-Length': '8388608', 'Content-MD5': 'UYiGy3DBwRnJmtG7tYZeeg==', 'Expect': '100-Continue', 'Date': 'Sun, 24 Jan 2016 16:47:06 GMT', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8='} boto: DEBUG: encountered error exception, reconnecting boto: DEBUG: establishing HTTP connection: kwargs={'port': 10946, 'timeout': 70} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT UYiGy3DBwRnJmtG7tYZeeg== application/octet-stream Sun, 24 Jan 2016 16:47:06 GMT /hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8= boto: DEBUG: Final headers: {'Content-Length': '8388608', 'Content-MD5': 'UYiGy3DBwRnJmtG7tYZeeg==', 'Expect': '100-Continue', 'Date': 'Sun, 24 Jan 2016 16:47:06 GMT', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8='} boto: DEBUG: encountered error exception, reconnecting boto: DEBUG: establishing HTTP connection: kwargs={'port': 10946, 'timeout': 70} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT UYiGy3DBwRnJmtG7tYZeeg== application/octet-stream Sun, 24 Jan 2016 16:47:06 GMT /hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8= boto: DEBUG: Final headers: {'Content-Length': '8388608', 'Content-MD5': 'UYiGy3DBwRnJmtG7tYZeeg==', 'Expect': '100-Continue', 'Date': 'Sun, 24 Jan 2016 16:47:06 GMT', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8='} boto: DEBUG: encountered error exception, reconnecting boto: DEBUG: establishing HTTP connection: kwargs={'port': 10946, 'timeout': 70} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT UYiGy3DBwRnJmtG7tYZeeg== application/octet-stream Sun, 24 Jan 2016 16:47:06 GMT /hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8= boto: DEBUG: Final headers: {'Content-Length': '8388608', 'Content-MD5': 'UYiGy3DBwRnJmtG7tYZeeg==', 'Expect': '100-Continue', 'Date': 'Sun, 24 Jan 2016 16:47:06 GMT', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8='} boto: DEBUG: encountered error exception, reconnecting boto: DEBUG: establishing HTTP connection: kwargs={'port': 10946, 'timeout': 70} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT UYiGy3DBwRnJmtG7tYZeeg== application/octet-stream Sun, 24 Jan 2016 16:47:06 GMT /hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8= boto: DEBUG: Final headers: {'Content-Length': '8388608', 'Content-MD5': 'UYiGy3DBwRnJmtG7tYZeeg==', 'Expect': '100-Continue', 'Date': 'Sun, 24 Jan 2016 16:47:06 GMT', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8='} boto: DEBUG: encountered error exception, reconnecting boto: DEBUG: establishing HTTP connection: kwargs={'port': 10946, 'timeout': 70} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT UYiGy3DBwRnJmtG7tYZeeg== application/octet-stream Sun, 24 Jan 2016 16:47:06 GMT /hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8= boto: DEBUG: Final headers: {'Content-Length': '8388608', 'Content-MD5': 'UYiGy3DBwRnJmtG7tYZeeg==', 'Expect': '100-Continue', 'Date': 'Sun, 24 Jan 2016 16:47:06 GMT', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8='} boto: DEBUG: encountered error exception, reconnecting boto: DEBUG: establishing HTTP connection: kwargs={'port': 10946, 'timeout': 70} boto: DEBUG: Token: None boto: DEBUG: StringToSign: PUT UYiGy3DBwRnJmtG7tYZeeg== application/octet-stream Sun, 24 Jan 2016 16:47:06 GMT /hoge-31vc4xw9yanbvc4liz7qbtnr-290/testobj boto: DEBUG: Signature: AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8= boto: DEBUG: Final headers: {'Content-Length': '8388608', 'Content-MD5': 'UYiGy3DBwRnJmtG7tYZeeg==', 'Expect': '100-Continue', 'Date': 'Sun, 24 Jan 2016 16:47:06 GMT', 'User-Agent': 'Boto/2.39.0 Python/2.7.3 Linux/3.13.0-63-generic', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS ABCDEFGHIJKLMNOPQRST:0Q0L04rAcx2sDu2jnojGn2ueae8='} boto: DEBUG: encountered error exception, reconnecting boto: DEBUG: establishing HTTP connection: kwargs={'port': 10946, 'timeout': 70} --------------------- >> end captured logging << ---------------------

akiradeveloper commented 8 years ago

huh? does finagle-http give up reading 8mb data? I can't believe it but I should try to reproduce

boto: DEBUG: encountered error exception, reconnecting
akiradeveloper commented 8 years ago

It's possible that it gives up reading giga-byte data because there is not streaming involved right now (will be improved by finch in the future)

akiradeveloper commented 8 years ago

seems to be 8mb file can't be put by aws-sdk-java because the client library rejects it (EntityTooLarge exception)

akiradeveloper commented 8 years ago

I set up finagle-http so it accepts entities up to 1GB size. And this issue is gone!