search

Pradeeplogme / s3-bash

Automatically exported from code.google.com/p/s3-bash
Other
0 stars 0 forks source link

s3-put hanging #23

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago 
Sometimes, s3-put hangs: I can see a curl-call in the ps aux output, but it's 
not doing anything. 
When i kill the curl-command, it continues, but the upload-file ist lost, 
because s3-put deletes it 
later, unfortunately without a correct upload.

I cannot say exactly when this problem occurs, it seems that from time to time, 
the s3-service is 
down for a short time, and all s3-put-commands I use in this time fail. It it 
possible to add a 
timeout somehow? And maybe add some error handling for this case? For example 
to add a number 
of retries if an upload fails.

Original issue reported on code.google.com by stefanoe...@gmail.com on 20 Apr 2010 at 1:07

GoogleCodeExporter commented 8 years ago 
I also have problem with hanging s3-put calls. I run several backup scripts 
that use
s3-put to push backup files (size: 25MB - 1,5GB) up to my S3 bucket. When this 
fails,
the curl-command takes 100% CPU time and the upload never finishes.

I also cannot reproduce the error, but error handling for this would be really 
great!

Original comment by jonas.ka...@gmail.com on 30 Apr 2010 at 8:35

GoogleCodeExporter commented 8 years ago 
Any progress on this? This is a serious issue since otherwise, the tool is not 
reliable.

Original comment by stefanoe...@gmail.com on 23 Jun 2010 at 12:32

GoogleCodeExporter commented 8 years ago 
I'm seeing the same problems described in Comment_1, with s3-put. curl takes up 
100% CPU and never finishes....

Original comment by paul.sh...@gmail.com on 26 Jun 2010 at 3:49

GoogleCodeExporter commented 8 years ago 
Same problem here...

 3008 13688  3008  3008 ?           -1 S      500   1:35  \_ crond
13688 13692 13692 13692 ?           -1 Ss     500   0:00      \_ /bin/sh -c 
/home/oracle/admin/scripts_backup/zip_copia_amazon_expdp.sh 
13692 13693 13692 13692 ?           -1 S      500   0:00      |   \_ /bin/bash 
/home/oracle/admin/scripts_backup/zip_copia_amazon_expdp.
13693 13963 13692 13692 ?           -1 S      500   0:00      |   |   \_ bash 
/tmp/s3-bash/s3-put/13963.curl.ZAK14164
13963 14168 13692 13692 ?           -1 R      500 14125:12      |   |       \_ 
curl -T /u01/backup/expdp_BIZ10G/biz.neoface.pt_expdb_201
13692 13694 13692 13692 ?           -1 S      500   0:00      |   \_ logger

Original comment by neof...@gmail.com on 4 Jul 2010 at 10:45