search

Russell-IO / s3fs

Automatically exported from code.google.com/p/s3fs
GNU General Public License v2.0
0 stars 0 forks source link

S3fs on Amazon EC2 Gentoo #57

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
I get strange behavior when rsyncing a large maildir-style mail directory to 
S3…

rsync -arvP --stats /var/spool/mail/virtual/amcgregor /var/spool/s3mail/

...
amcgregor/.maildir/.Travel/maildirfolder
           0 100%    0.00kB/s    0:00:00 (xfer#45, to-check=292/5756)
amcgregor/.maildir/.iPhone/maildirfolder
           0 100%    0.00kB/s    0:00:00 (xfer#46, to-check=259/5756)
file has vanished: 
"/var/spool/s3mail/amcgregor/.maildir/.iPhone/cur/.1242101320.M139279P9636.phobo
s,W=3
633:2,S.1RMqEf"
IO error encountered -- skipping file deletion

From log:

May 12 21:56:53 [s3fs] copy path=/amcgregor/.maildir/.Trash/maildirfolder
May 12 21:56:53 [s3fs] copy 
path=/amcgregor/.maildir/.Travel/.maildirfolder.s67j5t
May 12 21:56:53 [s3fs] upload 
path=/amcgregor/.maildir/.Travel/.maildirfolder.s67j5t size=0
May 12 21:56:54 [s3fs] copy 
path=/amcgregor/.maildir/.Travel/.maildirfolder.s67j5t
                - Last output repeated 2 times -
May 12 21:56:54 [s3fs] copy path=/amcgregor/.maildir/.Travel/maildirfolder
May 12 21:56:54 [s3fs] copy 
path=/amcgregor/.maildir/.iPhone/.maildirfolder.b3zKp9
May 12 21:56:54 [s3fs] upload 
path=/amcgregor/.maildir/.iPhone/.maildirfolder.b3zKp9 size=0
May 12 21:56:54 [s3fs] copy 
path=/amcgregor/.maildir/.iPhone/.maildirfolder.b3zKp9
                - Last output repeated 2 times -
May 12 21:56:54 [s3fs] copy path=/amcgregor/.maildir/.iPhone/maildirfolder
May 12 21:57:12 [s3fs] ###28 Timeout was reached
                - Last output repeated 2 times -
May 12 21:57:40 [s3fs] ###22 HTTP response code said error
May 12 21:59:05 [s3fs] destroy
May 12 21:59:17 [s3fs] init $Rev: 177 $

Original issue reported on code.google.com by TheRealGothAlice@gmail.com on 13 May 2009 at 5:10

GoogleCodeExporter commented 9 years ago 
Please give the latest tarball or svn revision a shot. Thanks.

Original comment by dmoore4...@gmail.com on 10 Nov 2010 at 6:33

GoogleCodeExporter commented 9 years ago 
The rsync operation now works, though it's pretty slow (even when backed with a 
cache).  I'll scrounge around in the what documentation there is for 
threading/multi-process operation.

Original comment by TheRealGothAlice@gmail.com on 26 Nov 2010 at 7:15

GoogleCodeExporter commented 9 years ago 
Considering this issue now fixed. Performance is another issue and connection 
upload/download speed. Please open a new issue if necessary.

Original comment by dmoore4...@gmail.com on 26 Nov 2010 at 10:17