search

pradeepgn / s3fs

Automatically exported from code.google.com/p/s3fs
GNU General Public License v2.0
0 stars 0 forks source link

Bucket not returning valid size #217

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
I have a bucket which is quite large ~1.4TB. I mounted it using s3fs. 
However when I do a du -h command I get sizes varying from 5GB-1.1TB. In 
addition when I do a rsync on a file larger that approx 2-3 GB it completes 
successfully however as soon as I rsync the file again (right after it has 
finished rsynching) it will re transfer the entire file all over again! I have 
described the problem in issue 206: 
http://code.google.com/p/s3fs/issues/detail?id=206 and the fix suggested by 
comment 12 (r537) does not seem to work for me.

Version of s3fs is 1.59 (the latest release)
Version of fuse 2.8.4
System is a i686 Linux machine (A virtual Amazon ec2 machine)
Ubuntu 10.10
s3fs-syslog: Aug 25 19:15:42 domU-12-31-39-0C-10-B3 s3fs: init $Rev: 355 $

Thank you for your assistance!

Original issue reported on code.google.com by falcat...@gmail.com on 25 Aug 2011 at 7:25

GoogleCodeExporter commented 8 years ago 
I don't have a bucket with that much data in it, so I'm able to reproduce the 
same results. Can you please provide the exact options you are using to mount 
the bucket (the fstab entry or the command line options)

Also, it would be very helpful if you could run s3fs in debug/foreground mode 
(-f -d) and provide the output from both syslog and the console.

Original comment by ben.lema...@sparkfun.com on 25 Aug 2011 at 7:42

GoogleCodeExporter commented 8 years ago 
[deleted comment]
GoogleCodeExporter commented 8 years ago 
I mount the bucket by: 'sudo s3fs -o allow_other bucketname /path/to/folder/'

Now I tried mounting it by using the -f option: 'sudo s3fs -f -o allow_other 
bucketname /home/ubuntu/s3'

and I got "s3fs_check_service" to display on the console at which point the 
system froze. System log says:
ubuntu@domU-12-31-39-0C-10-B3:~$ sudo grep s3fs /var/log/syslog
Aug 25 19:15:42 domU-12-31-39-0C-10-B3 s3fs: init $Rev: 355 $
Aug 25 20:10:00 domU-12-31-39-0C-10-B3 s3fs: curlCode: 0   msg: No error
Aug 25 20:10:00 domU-12-31-39-0C-10-B3 s3fs: responseCode: 200
Aug 25 20:10:00 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketname?location
Aug 25 20:10:00 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketname.s3.amazonaws.com?location
Aug 25 20:10:00 domU-12-31-39-0C-10-B3 s3fs: curlCode: 0   msg: No error
Aug 25 20:10:00 domU-12-31-39-0C-10-B3 s3fs: responseCode: 200
Aug 25 20:10:00 domU-12-31-39-0C-10-B3 s3fs: init $Rev: 355 $
Aug 25 20:10:31 domU-12-31-39-0C-10-B3 s3fs: destroy
Aug 25 20:11:04 domU-12-31-39-0C-10-B3 s3fs: init $Rev: 355 $

Original comment by falcat...@gmail.com on 25 Aug 2011 at 8:14

GoogleCodeExporter commented 8 years ago 
I then tried mounting with the -d option. Syslog says:

Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/100108_GENTLY_FC60095_L1_GTAT_pf.fastq.g
z
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/100108_GENTLY_FC60095_L1_CATT_pf.fastq.g
z
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/100108_GENTLY_FC60095_L1_CATT_pf.fastq.g
z
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/100104_MARPLE_FC600AT_L4_ACGT_pf.fastq.g
z
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/100104_MARPLE_FC600AT_L4_ACGT_pf.fastq.g
z
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/091218_SPADE_FC600AJ_L2_GTAT_pf.fastq.gz
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/091218_SPADE_FC600AJ_L2_GTAT_pf.fastq.gz
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.bucketName_2440_Snyder_N2_POLII_L4_rep1
_FC42PYGHM_20090902_s_2_GTAT.fastq.Q8YfEC
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.bucketName_2440_Snyder_N2_POLII_L4_rep1
_FC42PYGHM_20090902_s_2_GTAT.fastq.Q8YfEC
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.Snyder_LIN13_Input_emb_sequence_091208_
MAGNUM_FC42VVL_s_1_GTAT.fastq.nynjRs
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.Snyder_LIN13_Input_emb_sequence_091208_
MAGNUM_FC42VVL_s_1_GTAT.fastq.nynjRs
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR039451.fastq.ObcOus
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR039451.fastq.ObcOus
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR035417_2.fastq.kZ1VcJ
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR035417_2.fastq.kZ1VcJ
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR034782.fastq.csGEHL
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR034782.fastq.csGEHL
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR034223.fastq.gz.1BA1Zb
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR034223.fastq.gz.1BA1Zb
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR031764.fastq.gz.PQWwoR
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR031764.fastq.gz.PQWwoR
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR030322.fastq.gz.Ey1yXF
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR030322.fastq.gz.Ey1yXF
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR030271.fastq.gz.HmbSTw
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR030271.fastq.gz.HmbSTw
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR023735.fastq.PvLnWG
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR023735.fastq.PvLnWG
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR023720.fastq.2exPV9
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR023720.fastq.2exPV9
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR023700.fastq.NZxjFg
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR023700.fastq.NZxjFg
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR023684.fastq.eZ2Ogp
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR023684.fastq.eZ2Ogp
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR023602_1.fastq.R8N3GL
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR023602_1.fastq.R8N3GL
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR023599_1.fastq.U1u8Gx
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR023599_1.fastq.U1u8Gx
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR023547_2.fastq.dPb9ot
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR023547_2.fastq.dPb9ot
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR023538_2.fastq.tj4xX6
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR023538_2.fastq.tj4xX6
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR016675.fastq.gz.XHmkTC
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR016675.fastq.gz.XHmkTC
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR016675.fastq.gz.RjRkZi
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR016675.fastq.gz.RjRkZi
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR015090_1.fastq.gz.WsEMFK
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR015090_1.fastq.gz.WsEMFK
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR015086_1.fastq.gz.2YJ49r
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR015086_1.fastq.gz.2YJ49r
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.SRR006520.fastq.gz.juu4ZF
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.SRR006520.fastq.gz.juu4ZF
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.DM26.fastq.RViyyZ
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.DM26.fastq.RViyyZ
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.DM15.fastq.mjus53
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.DM15.fastq.mjus53
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.909_362740_2009-07-25_13-43_Area1_635.p
air.9djHo6
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.909_362740_2009-07-25_13-43_Area1_635.p
air.9djHo6
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.871_adultmale-K9Ac-3-251918210345.txt.F
d9MI1
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.871_adultmale-K9Ac-3-251918210345.txt.F
d9MI1
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.513_Dro2_AS_Dm_emb_4h_OR_RW_C01_B2_T1.c
el.ZMdrMG
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.513_Dro2_AS_Dm_emb_4h_OR_RW_C01_B2_T1.c
el.ZMdrMG
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.489_Db-24-1_pm_mm.wig.QVMAkL
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.489_Db-24-1_pm_mm.wig.QVMAkL
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.484_JYOU_CTIL_L1-3NDT_091708.CEL.a4iNPl
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.484_JYOU_CTIL_L1-3NDT_091708.CEL.a4iNPl
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.473_L4-1_pm_mm.wig.GfOcIC
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.473_L4-1_pm_mm.wig.GfOcIC
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.461_509DMM22-20080204-CeT.CEL.D24is0
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.461_509DMM22-20080204-CeT.CEL.D24is0
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.431_AdultFemale-K4Me3-2-251918210061.tx
t.gz.3EaAFC
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.431_AdultFemale-K4Me3-2-251918210061.tx
t.gz.3EaAFC
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.430_Female-K9Ac-2-251918310257.txt.bGsL
xz
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.430_Female-K9Ac-2-251918310257.txt.bGsL
xz
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.406_20-24-K9AC-1-251918310192.txt.gz.fT
8h0X
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.406_20-24-K9AC-1-251918310192.txt.gz.fT
8h0X
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.3387_Snyder_FOS-1_GFP_L1_rep1-1.wig.SuB
qso
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.3387_Snyder_FOS-1_GFP_L1_rep1-1.wig.SuB
qso
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.312_329.Mvalues.wig.ei95My
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.312_329.Mvalues.wig.ei95My
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2880_3_accepted_hits.DCCheader.sam.gz.3
qiom8
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2880_3_accepted_hits.DCCheader.sam.gz.3
qiom8
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2879_accepted_hits.DCCheader.sam.gz.YUM
2Dz
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2879_accepted_hits.DCCheader.sam.gz.YUM
2Dz
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2878_6_accepted_hits.DCCheader.sam.gz.w
AOK5I
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2878_6_accepted_hits.DCCheader.sam.gz.w
AOK5I
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2877_accepted_hits.DCCheader.sam.gz.woo
LHp
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2877_accepted_hits.DCCheader.sam.gz.woo
LHp
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2874_5_accepted_hits.DCCheader.sam.gz.O
ewCDw
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2874_5_accepted_hits.DCCheader.sam.gz.O
ewCDw
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2826_miRNA_embryos_solexa.ws190.sam.33l
0NG
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2826_miRNA_embryos_solexa.ws190.sam.33l
0NG
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2741_GSM364902.sam.N05M4X
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2741_GSM364902.sam.N05M4X
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2603_R13_1-6-GFP-B-252178110126.txt.CfH
WEp
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2603_R13_1-6-GFP-B-252178110126.txt.CfH
WEp
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2581_Adult_Harposporium_control_EcoliOP
50_exposed_2_24hrs.alignments.gff3.sam.LI9rDv
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2581_Adult_Harposporium_control_EcoliOP
50_exposed_2_24hrs.alignments.gff3.sam.LI9rDv
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2536_NimbHX_SOH21_p6PD_vs_SOH21_p6IN_26
9767-3_532.pair.E2axNe
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2536_NimbHX_SOH21_p6PD_vs_SOH21_p6IN_26
9767-3_532.pair.E2axNe
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2531_SOH36_80_vs_SOH36_MT_247383-2_cy3_
cy5_WS190.wig.5SKfNT
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2531_SOH36_80_vs_SOH36_MT_247383-2_cy3_
cy5_WS190.wig.5SKfNT
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2527_GSM387594_5-S2_600_271135_532.pair
.1x7UyA
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2527_GSM387594_5-S2_600_271135_532.pair
.1x7UyA
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2518_GSM333847_4NV80_237371_635.pair.gB
HYzu
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2518_GSM333847_4NV80_237371_635.pair.gB
HYzu
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2484_G_bowtie.map.sam.FfYgpd
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2484_G_bowtie.map.sam.FfYgpd
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL is 
http://s3.amazonaws.com/bucketName/data/.2345_Adult_spe-9_23dC_8days_post-L4_mol
t.alignments.gff3.sam.nYd5aD
Aug 25 20:14:20 domU-12-31-39-0C-10-B3 s3fs: URL changed is 
http://bucketName.s3.amazonaws.com/data/.2345_Adult_spe-9_23dC_8days_post-L4_mol
t.alignments.gff3.sam.nYd5aD

Original comment by falcat...@gmail.com on 25 Aug 2011 at 8:16

GoogleCodeExporter commented 8 years ago 
Thanks. I'll push some large files up to s3 this evening and see what comes 
out. My gut feeling tells me this may be associated with multipart uploads. If 
that's the case, you might be able to try the "nomultipart" option. Though, it 
probably has no effect on files which are already multipart uploads.

Original comment by ben.lema...@sparkfun.com on 25 Aug 2011 at 8:38

GoogleCodeExporter commented 8 years ago 
I've been testing with the latest release (1.61) and I'm unable to reproduce 
any of these issues. Can you give this a shot with the updated code and let me 
know how it turns out?

Original comment by ben.lema...@gmail.com on 30 Aug 2011 at 3:34

GoogleCodeExporter commented 8 years ago 
Not sure if this is the same issue but rsync tells me it has written complete 
files - and the time elapsed is consistent - but I end up with zero bytes.

The directory is also exported but that has not been an issue in the past.

Will continue testing.

Original comment by smb...@gmail.com on 31 Aug 2011 at 12:11

GoogleCodeExporter commented 8 years ago 
Hi

Revision 430 fixes issue 235 which is one of "Transport endpoint is not 
connected" error.
And latest version, I use and check it, and it seems that rsync works good on 
this version.

Please use latest revision(not packaged now), and if you have a problem yet, 
please re-post new issue.

Thanks in advance for your help.

Original comment by ggta...@gmail.com on 29 May 2013 at 6:30