search

klokan / webstor

High performance C++ API for Amazon S3
Apache License 2.0
1 stars 2 forks source link

Multipart indexing #22

Open ambitslix opened 9 years ago

ambitslix commented 9 years ago

Multipart upload fails, but this is due to issue in wsmcd client indexing of parts I believe.

Example of 1GB file:

wscmd -i "123" -s "456" -a put -n buxy -H localhost -P 8088 -f dildo -p TEST/dildo -z 256 -v Uploaded: 268435456 of 1073741824 Uploaded: 536870912 Uploaded: 805306368 Uploaded: 1073741824

The 'completeMultipartUpload' operation for 'TEST/dildo' failed. 500 Internal Server Error.

This is the log from fakeS3 server:

localhost.localdomain - - [12/Sep/2015:08:44:21 PDT] "POST /services/Walrus/buxy/TEST%2Fdildo?uploads HTTP/1.0" 200 251

-> /services/Walrus/buxy/TEST%2Fdildo?uploads localhost.localdomain - - [12/Sep/2015:08:44:21 PDT] "PUT /services/Walrus/buxy/TEST%2Fdildo?partNumber=1&uploadId=84a0fd783ca99370383f61eb9457280c HTTP/1.0" 200 0
-> /services/Walrus/buxy/TEST%2Fdildo?partNumber=1&uploadId=84a0fd783ca99370383f61eb9457280c localhost.localdomain - - [12/Sep/2015:08:44:22 PDT] "PUT /services/Walrus/buxy/TEST%2Fdildo?partNumber=2&uploadId=84a0fd783ca99370383f61eb9457280c HTTP/1.0" 200 0
-> /services/Walrus/buxy/TEST%2Fdildo?partNumber=2&uploadId=84a0fd783ca99370383f61eb9457280c localhost.localdomain - - [12/Sep/2015:08:44:23 PDT] "PUT /services/Walrus/buxy/TEST%2Fdildo?partNumber=3&uploadId=84a0fd783ca99370383f61eb9457280c HTTP/1.0" 200 0
-> /services/Walrus/buxy/TEST%2Fdildo?partNumber=3&uploadId=84a0fd783ca99370383f61eb9457280c localhost.localdomain - - [12/Sep/2015:08:44:24 PDT] "PUT /services/Walrus/buxy/TEST%2Fdildo?partNumber=4&uploadId=84a0fd783ca99370383f61eb9457280c HTTP/1.0" 200 0
-> /services/Walrus/buxy/TEST%2Fdildo?partNumber=4&uploadId=84a0fd783ca99370383f61eb9457280c [2015-09-12 08:44:25] ERROR Errno::ENOENT: No such file or directory - /mnt/RAM/FAKES3/services/84a0fd783ca99370383f61eb9457280c_Walrus/buxy/TEST/dildo_part0/.fakes3_metadataFFF/content /home/alian/.gem/ruby/gems/fakes3-0.2.1/lib/fakes3/file_store.rb:228:in initialize' /home/alian/.gem/ruby/gems/fakes3-0.2.1/lib/fakes3/file_store.rb:228:inopen' /home/alian/.gem/ruby/gems/fakes3-0.2.1/lib/fakes3/file_store.rb:228:in block in combine_object_parts' /home/alian/.gem/ruby/gems/fakes3-0.2.1/lib/fakes3/file_store.rb:224:ineach' /home/alian/.gem/ruby/gems/fakes3-0.2.1/lib/fakes3/file_store.rb:224:in combine_object_parts' /home/alian/.gem/ruby/gems/fakes3-0.2.1/lib/fakes3/server.rb:250:indo_POST' /usr/share/ruby/webrick/httpservlet/abstract.rb:106:in service' /usr/share/ruby/webrick/httpserver.rb:138:inservice' /usr/share/ruby/webrick/httpserver.rb:94:in run' /usr/share/ruby/webrick/server.rb:295:inblock in start_thread' localhost.localdomain - - [12/Sep/2015:08:44:25 PDT] "POST /services/Walrus/buxy/TEST%2Fdildo?uploadId=84a0fd783ca99370383f61eb9457280c HTTP/1.0" 500 437
-> /services/Walrus/buxy/TEST%2Fdildo?uploadId=84a0fd783ca99370383f61eb9457280c

Any thougths?