iterate-ch / cyberduck

Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.
https://cyberduck.io/
GNU General Public License v3.0
3.26k stars 290 forks source link

macOS Memory leak when transferring large amount of data from WebDAV server #15977

Open andtechgroup opened 4 months ago

andtechgroup commented 4 months ago

This ticket system is to report bugs and feature requests. For support, visit the help page first.

Describe the bug When transferring over 100GB of data from the cloud service Sharefile via WebDAV, Cyberduck uses a significant amount of RAM and swap disk. This issue has been observed on multiple Macs, including the Mac mini M2 Pro with 16GB of RAM and the Mac Studio M1 Max with 32GB of RAM.

To Reproduce Steps to reproduce the behavior:

  1. Connect to Webdav server
  2. Select files to transfer more than 100 GB. Monitor transfer processes as RAM usage increases exponentially during transfer until the system has no available memory, causing Cyberduck to become unresponsive and require a force quit.

Expected behavior I don't expect the cache data to be stored in RAM before being downloaded to the destination folder on the disk. (I assume that is what is occurring (?))

Screenshots I've been limiting my transfers to less than 100GB in order to complete the task of transferring. I've attached a screenshot of a current transfer of 65.7GB of data. The transfer is only 22% complete (14.9GB), but Cyberduck is already using 8.85GB of RAM and over 15GB of swap.

Screenshot 2024-05-30 at 4 39 21 PM

Desktop (please complete the following information): macOS Sonoma 14.5

Log Files Please include the log file. You can reach the logging output in Preferences → Connection.

cyberduck.log.zip

Additional context Using Cyberduck also triggers perpetual indexing for Spotlight on my hard drive, which may be unrelated.

dkocher commented 4 months ago

Possible duplicate for #15510.