xiongxu / s3fs

Automatically exported from code.google.com/p/s3fs
GNU General Public License v2.0
0 stars 0 forks source link

rsync --inplace causes instability #83

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1. rsync hierarchy of 8x200x32 ~3MB-long (total size of data is about 200G)
from on-instance storage to s3fs volume files with --inplace
2. notice that the thing fails quite often (say every 30mins to 3 hours)
claiming communication problems
3. notice that when rsync invoked repeatedly, the same files get rertansmitted
4. notice zero-sized files produced in the s3 bucket

5. don't use --inplace
6. notice it can run for days without failing.

What version of the product are you using? On what operating system?
s3fs r191

Please provide any additional information below.
the local caching was not being used with s3fs

Original issue reported on code.google.com by roman.pe...@gmail.com on 17 Mar 2010 at 12:16

GoogleCodeExporter commented 9 years ago
Please disregard, -oconnect_timeout=20 -oreadwrite_timeout=60 solved the 
problem.

Original comment by roman.pe...@gmail.com on 12 Apr 2010 at 9:39

GoogleCodeExporter commented 9 years ago
Marking this one closed. User found options to clear the issue. Please report 
any further problems seen. Thank you.

Original comment by dmoore4...@gmail.com on 19 Oct 2010 at 2:40