ropensci / ssh

Native SSH client in R based on libssh
https://docs.ropensci.org/ssh
Other
126 stars 21 forks source link

Problems wit large files with scp_download #54

Open ioandancus opened 2 years ago

ioandancus commented 2 years ago

Hi, Thank you for the nice package! It is very useful.

I have problems downloading large files using scp_download.

I need to download files that are on the order of 5-10 GB. The transfer starts and the R-programs seems to work intensively but I think that freezes. The file on the disk gets all the time to a maximum of 860,972 KB.

The server hosting the files is running centos and I tried to transfer the file using a windows 11 laptop and using a windows server 2012 R2. After the file reaches the 860,972 KB size you can see on the task manager that the network transfer is stopped.

I have no problems transferring the files using the WinSCP application.

The code that I am using is simple: I ssh to the server using:

session <- ssh_connect("zzzz@sssssss")

Then I start the transfer using:

scp_download(session, file_path, to = localDir, verbose = TRUE)

I also tried with verbose=FALSE.