search

prasmussen / gdrive

Google Drive CLI Client
MIT License
8.99k stars 1.19k forks source link

"context canceled" uploading realy large Files #127

Open derIckeBrln opened 8 years ago

derIckeBrln commented 8 years ago

Error with current version of gdrive2 and uploading large Files:

Uploading MYVM_FULL_BACKUP_20160404_0500/databasebackup.tar.gz 6.5 GB/7.2 GB, Rate: 2.6 MB/s Failed to upload file: context canceled

Didn't find any parameter to fix this by myself.

prasmussen commented 8 years ago

I will change the error message in the future, but it means that no data has been transferred for 2 minutes, so it gives up. This was added to gdrive2 to avoid uploads that hangs forever. Are you getting this error often? Do you have enough free space on drive?

derIckeBrln commented 8 years ago

Hi Petter,

I get this email currently every day... I have a 100gb-Drive and about 60gb left, so yes, enough space left to upload a 15gb file :)

btw. thanks for your great work... thomas

Reply sent via Mailstrom! http://mailstrom.co/

I will change the error message in the future, but it means that no data has been transferred for 2 minutes, so it gives up. This was added to gdrive2 to avoid uploads that hangs forever. Are you getting this error often? Do you have enough free space on drive?

You are receiving this because you authored the thread. Reply to this email directly or view it on GitHub: https://github.com/prasmussen/gdrive/issues/127#issuecomment-205455617

ghost commented 8 years ago

hi prasmussen, +1 here. 145MB file.

Uploading /tmp/svn.7z 512.0 B/145.0 MBFailed to upload file: context canceled`

i rarely back up this file on google drive, last success was with version 1.9.0

prasmussen commented 8 years ago

I've increased the default timeout to 5 minutes in v2.1.0 and added a --timeout flag. If you still get the timeout error you can set the timeout to 0 to disable the timeout logic.

derIckeBrln commented 8 years ago

timeout means for the whole transfer, from start to finish? Am 09.04.2016 10:05 nachm. schrieb "Petter Rasmussen" < notifications@github.com>:

I've increased the default timeout to 5 minutes in v2.1.0 and added a --timeout flag. If you still get the timeout error you can set the timeout to 0 to disable the timeout logic.

— You are receiving this because you authored the thread. Reply to this email directly or view it on GitHub https://github.com/prasmussen/gdrive/issues/127#issuecomment-207845885

derIckeBrln commented 8 years ago

The timeout doesnt work... Started the following at 16:00 today: gdrive2 upload --no-progress --timeout 1800 -r -p $ParentID $UploadFolder and it is still running don't doing anything. Currently running the same without --no-progress to see its process/error, but seems to run fine.

Any Idea?

Update1: By the way, found some hanging processes from the last few days too... seems any condition makes the gdrive2-process never to stop, even after 4-5days running

Update2: Ok, and after some tests some new input: Run with progress-Output: gdrive2 upload --timeout 1800 -r -p $ParentID $UploadFolder Uploaded all Items, and showed this in shell. Also showed the progress while uploading. After Uploading the last Item the Progress-Indicator gone away and after the last "Uploading "-Line theres just an empty line in the shell, but the process itself did not stop. Creating directory TEST_FULL_BACKUP_20160410_1516 Uploading /data/backups/TEST_FULL_BACKUP_20160410_1516/package-states-manual Uploading /data/backups/TEST_FULL_BACKUP_20160410_1516/package-states-auto Uploading /data/backups/TEST_FULL_BACKUP_20160410_1516/packages.list Uploading /data/backups/TEST_FULL_BACKUP_20160410_1516/fullbackup.tar.gz

Hope that helps?

Update3: The last (and largest) file (fullbackup.tar.gz) is listed in the upload-list and seemed to be uploaded 100%, as the progress indicated before it faded away. But now i saw, it does not show up in drive... Maybe there is an issue with completing the fileupload in the end?

y-ksenia commented 5 years ago

I've increased the default timeout to 5 minutes in v2.1.0 and added a --timeout flag. If you still get the timeout error you can set the timeout to 0 to disable the timeout logic.

The flag doesn't work for me. Got

No valid arguments given, use 'gdrive help' to see available commands

after running gdrive upload --timeout 0 -r -p $ParentID $UploadFolder

Ahmed-Shibl commented 5 years ago

Has this issue been resolved? I got the error "Failed to upload file: context canceled"...

motsmanish commented 5 years ago

Same issue: "Failed to upload file: context canceled"

Brandin commented 4 years ago

I'm curious if anyone has found a resolution to this? I'm not getting context cancelled, but I am having another issue similarly related to large files (small ones upload without issues) that is being produced. I've seen it fail at 100mb and 800mb, 10 seconds and 30 seconds, everything in between. I can't find a connection that I can try to debug, and when using the --timeout 0 to try to resolve the issue, no dice.

Thanks for any thoughts you have in advance.

https://pastebin.com/L4DkgCAK