chstath / gss

Automatically exported from code.google.com/p/gss
Other
0 stars 0 forks source link

uploads over 4gb are always rounded to 4gb size #94

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1. upload file over 4gb size with google chrome (I am using version 
11.0.696.60) from windows 7 (64bit)
2. wait for upload to finish
3. download file and compare original and uploaded file size - they differ

What is the expected output? What do you see instead?

Expected is file uploaded with correct size as is before uploading, and not 
rounded to 4gb. As server.log shows both files are exactly the same size of 4gb:

05 May 2011 12:34:48,041 ajp-0.0.0.0-8009-6 DEBUG () 
[gr.ebs.gss.server.rest.FilesHandler] Serving resource 
'/backup/debian-6.0.1a-i386-DVD-5.iso' headers only
05 May 2011 12:34:48,041 ajp-0.0.0.0-8009-9 DEBUG () 
[gr.ebs.gss.server.rest.FilesHandler] Serving resource 
'/backup/natty-dvd-amd64.iso' headers only
05 May 2011 12:34:48,098 ajp-0.0.0.0-8009-6 DEBUG () 
[gr.ebs.gss.server.rest.FilesHandler] contentType='application/octet-stream'
05 May 2011 12:34:48,098 ajp-0.0.0.0-8009-6 DEBUG () 
[gr.ebs.gss.server.rest.FilesHandler] contentLength=4294967295
05 May 2011 12:34:48,103 ajp-0.0.0.0-8009-9 DEBUG () 
[gr.ebs.gss.server.rest.FilesHandler] contentType='application/octet-stream'
05 May 2011 12:34:48,103 ajp-0.0.0.0-8009-9 DEBUG () 
[gr.ebs.gss.server.rest.FilesHandler] contentLength=4294967295

In the beginning of the upload file sizes were like this:

05 May 2011 12:04:39,988 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] [PUT] 
/ngarafol@srce.hr/files/backup/debian-6.0.1a-i386-DVD-5.iso
05 May 2011 12:04:39,989 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] host: 192.168.0.1
05 May 2011 12:04:39,989 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] connection: keep-alive
05 May 2011 12:04:39,989 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] content-length: 4678600704

and 

05 May 2011 10:36:44,588 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] [PUT] 
/ngarafol@srce.hr/files/backup/natty-dvd-amd64.iso
05 May 2011 10:36:44,589 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] host: 192.168.0.1
05 May 2011 10:36:44,589 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] connection: keep-alive
05 May 2011 10:36:44,589 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] content-length: 4343263232
05 May 2011 10:36:44,589 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] pragma: no-cache
05 May 2011 10:36:44,590 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] Cache-Control: no-cache
05 May 2011 10:36:44,590 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] X-GSS-Date: Thu, 05 May 2011 08:36:44 
GMT
05 May 2011 10:36:44,590 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] authorization: ngarafol@srce.hr 
+Nn3q0w83pt0QDeBerw/sbH0Ask=
05 May 2011 10:36:44,590 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] accept: application/json; charset=utf-8
05 May 2011 10:36:44,590 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] content-type: application/octet-stream
05 May 2011 10:36:44,591 ajp-0.0.0.0-8009-8 DEBUG () 
[gr.ebs.gss.server.rest.RequestHandler] user-agent: Mozilla/5.0 (Windows NT 
6.1; WOW64) AppleWebKit/534.24 (KHTML, like Gecko) C
hrome/11.0.696.60 Safari/534.24

What version of the product are you using? On what operating system?

We are using gss built from source dated 30/11/2010 and 09/03/2011 on Centos 5 
64bit and same issue happens. 

Please provide any additional information below.

Can you test with over 4gb files and see whether you experience same issue?

Regards,
Nikola

Original issue reported on code.google.com by ngara...@gmail.com on 5 May 2011 at 11:04

GoogleCodeExporter commented 9 years ago
I thought you couldn't upload files over 4 GB size (Issue 93). Do I understand 
correctly that FF 4, IE 8 fail and Chrome 11 exhibits this rounding problem?

If so, are older FF / Chrome versions ok?

Original comment by fstamate...@gmail.com on 5 May 2011 at 2:07

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
As I explained in reply to issue 93, that problems were caused by POST requests 
for file uploads. This issue 94 is caused with browsers that use PUT request 
for uploading files - for now I only tested Google Chrome 11.0.696.60 on 
Windows 7 64 bit. File uploading works but there is this weird 4GB file size 
rounding issue making files unusable. This issue is only related to Windows 7 
64bit for now ( I have to try 32bit windows xp too), because on (Arch) Linux 
with Google Chrome development edition version 12.0.742.12-1 I can upload 4.5GB 
file without problems, and file is working as expected. I hope normal google 
chrome version on Linux should work too. 

Linux client machine is Arch Linux 64 bit. Server is Centos 5 64bit.

Firefox 3.6.x seems to use PUT request for uploads, but I did not do test 
scenario with that version. 

Again, no google gears is installed, hope that is ok for working with bigger 
files. I understand google gears is only used for multiple file uploads?

Regards,
Nikola

Original comment by ngara...@gmail.com on 5 May 2011 at 5:26

GoogleCodeExporter commented 9 years ago
Thanks Nikola for the clarifications.

Yes gears is only used for multiple file uploads.

Original comment by fstamate...@gmail.com on 6 May 2011 at 10:29

GoogleCodeExporter commented 9 years ago
Test Scenario: Upload a file of 6,17GB and then download it
Result: Success
Browser: Chrome 11.0.696.65
OS: Windows Vista Home 32bit
File Size: 6,17 GB (6630569275 byte)
Method used in request: PUT
Content-length: accurate (content-length: 6630569275)

I've uploaded successfully the file using google chrome and then I've 
downloaded and compared two file sizes. They match, so I couldn't reproduce the 
problem in Windows Vista 32 bit.

Original comment by akaprave...@gmail.com on 12 May 2011 at 9:00

GoogleCodeExporter commented 9 years ago
Same here using Windows 7 32 bit and same version of chrome as you, Chrome 
11.0.696.65. File over 8GB uploads, shows with right size, and after download 
is also the same size. Seems like issue is related to x64 (64bit) versions of 
Windows then?

I will do some tests on 64bit, but I think it will fail.

Regards,
Nikola

Original comment by ngara...@gmail.com on 12 May 2011 at 11:55

GoogleCodeExporter commented 9 years ago
Tried again on Windows 7 64bit with Chrome 11.0.696.65 and upload stops, and 
network activity too. I think I hit 4GB limit with upload of 6.35GB file, and 
then it stopped with no network activity. I am 100% sure this upload will fail, 
since it is stopped for too long now.

Regards,
Nikola

Original comment by ngara...@gmail.com on 12 May 2011 at 12:25