search

skoobe / riofs

Userspace S3 filesystem
GNU General Public License v3.0
393 stars 60 forks source link

Failure on multipart upload #131

Open ScatteredRay opened 7 years ago

ScatteredRay commented 7 years ago

I seem to have a sporadic issue on what seems to be a multi-part issue. I have the riofs mount on the network, and am doing a large copy. After a while I'll start getting some failures, a manual retry seems to succeed, but until riofs is restarted it seems to continue to get into the similar state. Here is the error I'm gatting:

ERROR! [ino: 5467, con: 0x1fbd990] Failed to send bufer to server !
ERROR! [ino: 5467] Write call with offset 27262976 is not allowed !
ERROR! [ino: 5467] Write call with offset 28311552 is not allowed !
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 1 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 2 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 3 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 4 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 5 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 6 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 7 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 8 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 9 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 10 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 11 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 12 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 13 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 14 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 15 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 16 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 17 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 18 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 19 of 20
ERROR! [con: 0x1fbcfb0] Server returned HTTP error: 400 (Bad Request)! Retry ID: 20 of 20
ERROR! [con: 0x1fbcfb0] Reached the maximum number of retries !
ERROR! [ino: 5467, con: 0x1fbcfb0] Failed to send Multipart data to the server !
wizzard commented 7 years ago

Hello, could you please run riofs in "verbose" mode (-v), reproduce the issue and upload log file to some file sharing service? I'd like to see the full log.

Usually the error "Write call with offset .." indicates that you're trying to write file's chunks non sequentially (e.g.: calling seek() before write() ), RioFS does not support such functionality.