search

lavv17 / lftp

sophisticated command line file transfer program (ftp, http, sftp, fish, torrent)
http://lftp.yar.ru
GNU General Public License v3.0
1.1k stars 161 forks source link

mirror 0 byte files / empty files are failing #618

Open helllicht opened 3 years ago

helllicht commented 3 years ago

probably related to:

We want to use lftp in our future deployment process.

lftp -u "$USER","$PASSWORD" $HOST <<EOF
set ftp:ssl-force true
set ssl:check-hostname no
set sftp:auto-confirm yes
mirror -v -Ren $UPLOAD $REMOTE $IGNORE;
exit
EOF

lftp just gets stuck with files that have no content. In our project there are some optional config files (yml) that are empty by default. Also some html files.

I cancelled the process after a few minutes...

with -v we couldn't see some more interesting information.

lavv17 commented 3 years ago

Please try to enable debug in lftp to see what happens.

On Tue, 9 Feb 2021 at 15:59, helllicht notifications@github.com wrote:

probably related to: #465 https://github.com/lavv17/lftp/issues/465

We want to use lftp in our future deployment process.

lftp -u "$USER","$PASSWORD" $HOST <<EOF set ftp:ssl-force true set ssl:check-hostname no set sftp:auto-confirm yes mirror -v -Ren $UPLOAD $REMOTE $IGNORE; exit EOF

lftp just gets stuck with files that have no content. In our project there are some optional config files (yml) that are empty by default. Also some html files.

I cancelled the process after a few minutes...

with -v we couldn't see some more interesting information.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/lavv17/lftp/issues/618, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAHLWXEQKRDV7VXVLPUVRLDS6EWS5ANCNFSM4XK6MKSA .

-- Alexander.

kk-hiraskar commented 1 year ago

I am getting same issue, when target is remote, files are transferred as 0KB files. not seeing any issue in debug output also.

OS: RHEL 8.7 Tried with yum released version 4.8.4, and also compiled source with that also tried.

$ lftp -d -e 'set sftp:auto-confirm yes; set sftp:connect-program "ssh -a -x -i /scripts/sftp_mirror/sftp_private.key"; mirror --reverse --verbose  /tmp/sync/1 sftp://ADMIN:"none"@129.100.50.3:5019/KK/ft/OS/130/archived; bye'

---- Running connect program (ssh -a -x -i /scripts/sftp_mirror/sftp_private.key -s -l ADMIN -p 5019 129.100.50.3 sftp)
---> sending a packet, length=5, type=1(INIT), id=0
<--- got a packet, length=561, type=2(VERSION), id=0
---- protocol version set to 6
---> sending a packet, length=10, type=16(REALPATH), id=1
<--- got a packet, length=44, type=104(NAME), id=1
---- home set to /home/users/ADMIN
---- path on wire is `/KK'
---> sending a packet, length=21, type=14(MKDIR), id=2
---- path on wire is `/KK/ft'
---> sending a packet, length=29, type=14(MKDIR), id=3
---- path on wire is `/KK/ft/OS'
---> sending a packet, length=32, type=14(MKDIR), id=4
---- path on wire is `/KK/ft/OS/130'
---> sending a packet, length=36, type=14(MKDIR), id=5
---- path on wire is `/KK/ft/OS/130/archived'
---> sending a packet, length=45, type=14(MKDIR), id=6
<--- got a packet, length=46, type=101(STATUS), id=2
---- status code=11(File already exists), message=File/Directory already exists
<--- got a packet, length=46, type=101(STATUS), id=3
---- status code=11(File already exists), message=File/Directory already exists
<--- got a packet, length=46, type=101(STATUS), id=4
---- status code=11(File already exists), message=File/Directory already exists
<--- got a packet, length=46, type=101(STATUS), id=5
---- status code=11(File already exists), message=File/Directory already exists
<--- got a packet, length=46, type=101(STATUS), id=6
---- status code=11(File already exists), message=File/Directory already exists
---- checking directory `/KK/ft/OS/130/archived'
---> sending a packet, length=44, type=17(STAT), id=7
---> sending a packet, length=46, type=17(STAT), id=8
<--- got a packet, length=30, type=105(ATTRS), id=7
<--- got a packet, length=30, type=105(ATTRS), id=8
---- path on wire is `/KK/ft/OS/130/archived'
---> sending a packet, length=40, type=11(OPENDIR), id=9
<--- got a packet, length=41, type=102(HANDLE), id=9
---- got file handle 3837366633343234383231323061643938663034383430653530623731613034 (32)
---> sending a packet, length=41, type=12(READDIR), id=10
<--- got a packet, length=159, type=104(NAME), id=10
---- file name count=3
---- eof
---> sending a packet, length=41, type=4(CLOSE), id=11
<--- got a packet, length=17, type=101(STATUS), id=11
---- status code=0(OK), message=
Removing old file `KSG_M2023033101.zip.gpg20230402143234'
Transferring file `KSG_M2023033101.zip.gpg20230402143234'
---- path on wire is `/KK/ft/OS/130/archived/KSG_M2023033101.zip.gpg20230402143234'
---> sending a packet, length=92, type=13(REMOVE), id=12
<--- got a packet, length=17, type=101(STATUS), id=12
---- status code=0(OK), message=
---- path on wire is `/KK/ft/OS/130/archived/KSG_M2023033101.zip.gpg20230402143234'
---> sending a packet, length=105, type=3(OPEN), id=13
<--- got a packet, length=41, type=102(HANDLE), id=13
---- got file handle 3234373134373766343839323435323337376439643331303436386565333361 (32)
---- eof
---> sending a packet, length=32821, type=6(WRITE), id=14
---> sending a packet, length=3007, type=6(WRITE), id=15
---> sending a packet, length=62, type=10(FSETSTAT), id=16
---> sending a packet, length=41, type=4(CLOSE), id=17
<--- got a packet, length=17, type=101(STATUS), id=14
---- status code=0(OK), message=
<--- got a packet, length=17, type=101(STATUS), id=15
---- status code=0(OK), message=
<--- got a packet, length=32, type=101(STATUS), id=16
---- status code=4(Failure), message=General failure
<--- got a packet, length=17, type=101(STATUS), id=17
---- status code=0(OK), message=
---- path on wire is `/KK/ft/OS/130/archived/KSG_M2023033101.zip.gpg20230402143234'
---> sending a packet, length=101, type=9(SETSTAT), id=18
<--- got a packet, length=17, type=101(STATUS), id=18
---- status code=0(OK), message=
Modified: 1 file, 0 symlinks
35722 bytes transferred
---- Disconnecting
kk-hiraskar commented 1 year ago

just I found that, transfers are happening good in OL7 but not on OL8 . Many blogs indicating OL8 ftp issues. and suggesting patches. instead going to OL7 or 9 is easier..