Downloading larger files (8K+) from bucket fails

[robklg]

Bug with (at least):

• Proxy protocol mode enabled
• GCS Bucket backend.
• FTPS disabled

Same issue not occurring with filesystem backend.

This works: Downloading a file of 2KB size.

A larger file, starting at 8KB+ gives issues:

---- Connecting data socket to (XX.XX.XX.33) port 2003
---- Data connection established
---> RETR garbage.bin
<--- 150 Sending Data                              
<--- 226 Successfully sent
---- Got EOF on data connection
---- Closing data socket
expected pos=8192, actual pos=7115
get: garbage.bin: file size decreased during transfer

lftp XX.XX.XX.33:/> !gdu -b garbage.bin-new
7115    garbage.bin-new

The output of unFTP:

May 12 13:17:55.736 INFO Data command received: Retr { path: "garbage.bin" }
May 12 13:17:55.820 INFO Processing control channel event InternalMsg(SendingData)
May 12 13:17:55.821 INFO Processing control channel event InternalMsg(SendData { bytes: 7122 })
May 12 13:20:55.860 INFO Processing control channel event Command(Quit)

[robklg]

Next steps:

• Test locally
• Test with proxy protocol mode disabled
• Add more instrumentation

[hannesdejager]

Reproduced this with a 13 MB file. Simply upload it and the try to GET it again.