search

keroscarel / s3backer

Automatically exported from code.google.com/p/s3backer
GNU General Public License v2.0
0 stars 0 forks source link

I/O error on mounted filesystem, Unknown error:0 in debug output #19

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
$ opt/s3backer/bin/s3backer --blockSize=128k --size=1t --listBlocks 
rptb1-backup-test2 tmp/rptb1-backup-test2
$ file tmp/rptb1-backup-test2
tmp/rptb1-backup-test2: cannot open `tmp/rptb1-backup-test2' (Input/output 
error)

So I tried:

$ opt/s3backer/bin/s3backer -s -d --blockSize=128k --size=1t --listBlocks 
rptb1-backup-test2 tmp/rptb1-backup-test2
s3backer: auto-detecting block size and total file size...
2010-09-22 17:22:01 DEBUG: HEAD 
http://s3.amazonaws.com/rptb1-backup-test2/00000000
2010-09-22 17:22:01 DEBUG: rec'd 404 response: HEAD 
http://s3.amazonaws.com/rptb1-backup-test2/00000000
s3backer: auto-detection failed; using configured block size 128k and file size 
1t
s3backer: listing non-zero blocks...2010-09-22 17:22:01 DEBUG: GET 
http://s3.amazonaws.com/rptb1-backup-test2?prefix=&max-keys=256
2010-09-22 17:22:01 DEBUG: success: GET 
http://s3.amazonaws.com/rptb1-backup-test2?prefix=&max-keys=256
done
s3backer: found 0 non-zero blocks
2010-09-22 17:22:01 DEBUG: s3backer config:
2010-09-22 17:22:01 DEBUG:                test mode: "false"
2010-09-22 17:22:01 DEBUG:                 accessId: [redacted]
2010-09-22 17:22:01 DEBUG:                accessKey: "****"
2010-09-22 17:22:01 DEBUG:               accessFile: 
"/Users/rb/.s3backer_passwd"
2010-09-22 17:22:01 DEBUG:               accessType: private
2010-09-22 17:22:01 DEBUG:                  baseURL: "http://s3.amazonaws.com/"
2010-09-22 17:22:01 DEBUG:                   bucket: "rptb1-backup-test2"
2010-09-22 17:22:01 DEBUG:                   prefix: ""
2010-09-22 17:22:01 DEBUG:              list_blocks: true
2010-09-22 17:22:01 DEBUG:                    mount: "tmp/rptb1-backup-test2"
2010-09-22 17:22:01 DEBUG:                 filename: "file"
2010-09-22 17:22:01 DEBUG:           stats_filename: "stats"
2010-09-22 17:22:01 DEBUG:               block_size: 128k (131072)
2010-09-22 17:22:01 DEBUG:                file_size: 1t (1099511627776)
2010-09-22 17:22:01 DEBUG:               num_blocks: 8388608
2010-09-22 17:22:01 DEBUG:                file_mode: 0600
2010-09-22 17:22:01 DEBUG:                read_only: false
2010-09-22 17:22:01 DEBUG:                 compress: 0
2010-09-22 17:22:01 DEBUG:               encryption: (none)
2010-09-22 17:22:01 DEBUG:                 password: ""
2010-09-22 17:22:01 DEBUG:                  timeout: 30s
2010-09-22 17:22:01 DEBUG:      initial_retry_pause: 200ms
2010-09-22 17:22:01 DEBUG:          max_retry_pause: 30000ms
2010-09-22 17:22:01 DEBUG:          min_write_delay: 500ms
2010-09-22 17:22:01 DEBUG:           md5_cache_time: 10000ms
2010-09-22 17:22:01 DEBUG:           md5_cache_size: 10000 entries
2010-09-22 17:22:01 DEBUG:         block_cache_size: 1000 entries
2010-09-22 17:22:01 DEBUG:      block_cache_threads: 20 threads
2010-09-22 17:22:01 DEBUG:      block_cache_timeout: 0ms
2010-09-22 17:22:01 DEBUG:  block_cache_write_delay: 250ms
2010-09-22 17:22:01 DEBUG:    block_cache_max_dirty: 0 blocks
2010-09-22 17:22:01 DEBUG:         block_cache_sync: false
2010-09-22 17:22:01 DEBUG:               read_ahead: 4 blocks
2010-09-22 17:22:01 DEBUG:       read_ahead_trigger: 2 blocks
2010-09-22 17:22:01 DEBUG:   block_cache_cache_file: ""
2010-09-22 17:22:01 DEBUG:    block_cache_no_verify: "false"
2010-09-22 17:22:01 DEBUG: fuse_main arguments:
2010-09-22 17:22:01 DEBUG:   [0] = "opt/s3backer/bin/s3backer"
2010-09-22 17:22:01 DEBUG:   [1] = 
"-ofsname=http://s3.amazonaws.com/rptb1-backup-test2/"
2010-09-22 17:22:01 DEBUG:   [2] = "-o"
2010-09-22 17:22:01 DEBUG:   [3] = 
"kernel_cache,allow_other,use_ino,max_readahead=0,subtype=s3backer,entry_timeout
=31536000,negative_timeout=31536000,attr_timeout=0,default_permissions,nodev,nos
uid,daemon_timeout=600"
2010-09-22 17:22:01 DEBUG:   [4] = "-s"
2010-09-22 17:22:01 DEBUG:   [5] = "-d"
2010-09-22 17:22:01 DEBUG:   [6] = "tmp/rptb1-backup-test2"
2010-09-22 17:22:01 INFO: s3backer process 48602 for tmp/rptb1-backup-test2 
started
unique: 0, opcode: INIT (26), nodeid: 0, insize: 56
INIT: 7.8
flags=0x00000000
max_readahead=0x00100000
   INIT: 7.8
   flags=0x00000000
   max_readahead=0x00000000
   max_write=0x00400000
   unique: 0, error: 0 (Unknown error: 0), outsize: 40
unique: 0, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 0, error: 0 (Unknown error: 0), outsize: 96
unique: 0, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 0, error: 0 (Unknown error: 0), outsize: 96
unique: 0, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 0, error: 0 (Unknown error: 0), outsize: 96
unique: 1, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 1, error: 0 (Unknown error: 0), outsize: 96
unique: 0, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 0, error: 0 (Unknown error: 0), outsize: 96
unique: 0, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 0, error: 0 (Unknown error: 0), outsize: 96
unique: 0, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 0, error: 0 (Unknown error: 0), outsize: 96
unique: 2, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 2, error: 0 (Unknown error: 0), outsize: 96
unique: 3, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 3, error: 0 (Unknown error: 0), outsize: 96
unique: 1, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 1, error: 0 (Unknown error: 0), outsize: 96
unique: 0, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 0, error: 0 (Unknown error: 0), outsize: 128
unique: 2, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 2, error: 0 (Unknown error: 0), outsize: 128
unique: 3, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 3, error: 0 (Unknown error: 0), outsize: 96
unique: 1, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 1, error: 0 (Unknown error: 0), outsize: 128
unique: 3, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 3, error: 0 (Unknown error: 0), outsize: 128
unique: 4, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 4, error: 0 (Unknown error: 0), outsize: 128
unique: 5, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 5, error: 0 (Unknown error: 0), outsize: 128
unique: 6, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 6, error: 0 (Unknown error: 0), outsize: 128
unique: 7, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 7, error: 0 (Unknown error: 0), outsize: 96
unique: 8, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 8, error: 0 (Unknown error: 0), outsize: 128
unique: 7, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 7, error: 0 (Unknown error: 0), outsize: 128
unique: 9, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 9, error: 0 (Unknown error: 0), outsize: 96
unique: 9, opcode: GETATTR (3), nodeid: 1, insize: 40
   unique: 9, error: 0 (Unknown error: 0), outsize: 128
unique: 10, opcode: STATFS (17), nodeid: 1, insize: 40
   unique: 10, error: 0 (Unknown error: 0), outsize: 96

Original issue reported on code.google.com by richard....@gmail.com on 22 Sep 2010 at 4:23

GoogleCodeExporter commented 8 years ago 
I also tried this command from the wiki page MacOSHints

$ opt/s3backer/bin/s3backer -s -d --prefix=dmgtest --compress --blockSize=1m 
--size=100g --filename=dmgtest.dmg --listBlocks rptb1-backup-test2 
tmp/rptb1-backup-test2

However

$ file tmp/rptb1-backup-test2/dmgtest.dmg
tmp/rptb1-backup-test2/dmgtest.dmg: cannot open 
`tmp/rptb1-backup-test2/dmgtest.dmg' (Input/output error)

Same results with --ssl and --vhost.

Original comment by richard....@gmail.com on 22 Sep 2010 at 4:38

GoogleCodeExporter commented 8 years ago 
I was able to reproduce this problem.

Not sure what it is though. The trace doesn't show s3backer returning any 
errors (all error codes are zero) so the I/O error must be coming from FUSE 
itself.

There is probably some incompatibility that has been added in newer versions of 
MacFUSE.

I'm not much of a Mac expert so I'm not sure how to start debugging this. Might 
be worth asking on the MacFUSE mailing list, perhaps someone there can easily 
spot the problem.

Original comment by archie.c...@gmail.com on 22 Sep 2010 at 5:04

GoogleCodeExporter commented 8 years ago 
I fixed this on my mac with MacFUSE 2.0.x by doing the following:

./autogen.sh
./configure
perl -p -i -e 's/-lfuse/-lfuse_ino64/g' Makefile
make
make install

Original comment by dysin...@gmail.com on 5 Mar 2011 at 3:59

GoogleCodeExporter commented 8 years ago 
I think this can be closed.  MacFUSE is dead and has been replaced by Fuse4X.  
Fuse4X has joined the MacPort collection, and s3backer works fine with it, but 
see issue 32 about configuration.

Original comment by richard....@gmail.com on 4 Aug 2011 at 5:11

GoogleCodeExporter commented 8 years ago

Original comment by archie.c...@gmail.com on 4 Aug 2011 at 8:48