search

s3fs-fuse / s3fs-fuse

FUSE-based file system backed by Amazon S3
GNU General Public License v2.0
8.72k stars 1.02k forks source link

s3fs occasionally experiences 100% CPU usage and tens of GB of memory consumption #2522

Open yuqaf1989 opened 3 months ago

yuqaf1989 commented 3 months ago

Additional Information

Version of s3fs being used (s3fs --version)

V1.94 (commit:70a30d6) with GnuTLS(gcrypt) V1.9.0 have the same issue

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse or dpkg -s fuse)

Version: 2.9.9-5ubuntu3 Depends: libc6 (>= 2.34), libfuse2 (= 2.9.9-5ubuntu3), adduser, mount (>= 2.19.1), sed (>= 4)

Kernel information (uname -r)

5.15.0-119-generic

GNU/Linux Distribution, if applicable (cat /etc/os-release)

PRETTY_NAME="Ubuntu 22.04.4 LTS" NAME="Ubuntu" VERSION_ID="22.04" VERSION="22.04.4 LTS (Jammy Jellyfish)" VERSION_CODENAME=jammy ID=ubuntu ID_LIKE=debian HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" UBUNTU_CODENAME=jammy

How to run s3fs, if applicable

[] /etc/fstab 

s3 /s3 fuse.s3fs _netdev,allow_other,use_path_request_style,umask=0002,uid=1000,gid=1000,url=https://selfhost 0 0

s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)

Details about issue

s3fs occasionally experiences 100% CPU usage and tens of GB of memory consumption. Using perf top -p $pid, the output indicates that the call to std::vector<std::unique_ptr<S3fsCurl, std::default_delete >, std::allocator<std::unique_ptr<S3fsCurl, std::default_delete > > >::_M_erase consumes all CPU resources. 2024-09-03_14-40

patrickmagyarskaylink commented 2 months ago

we have the behavior too. maybe related to: https://github.com/s3fs-fuse/s3fs-fuse/issues/2509