search

keybase / client

Keybase Go Library, Client, Service, OS X, iOS, Android, Electron
BSD 3-Clause "New" or "Revised" License
8.92k stars 1.23k forks source link

Keybase desktop app made 56GB of disk writes in a 36hr runtime period #21376

Open NewAlexandria opened 5 years ago

NewAlexandria commented 5 years ago

For details, see the discussion on keybasefriends#general on 2019-12-03.

my log id: e6c623c424df580d38dfc01c

excerpted Timeline of process writes:

maxtaco commented 5 years ago

Thanks, we'll hopefully take a look soon.

maxtaco commented 5 years ago

Are you running any sort of bot or script or anything else we should know about?

NewAlexandria commented 5 years ago

Good question. No, or not that I'm aware of. If I think of anything that would regularly touch that dir, I'll mention it. Not running an AV that targets that dir, e.g.

Roger-Shepherd commented 5 years ago

I've had the same issue - I opened #21403 (https://github.com/keybase/client/issues/21403#issue-533295661) which I've closed now I've found this thread. Yes I did check outstanding issues before posting but I missed it.

I said:

I'm new here - I've had a quick look at outstanding issues... I came because I noticed keybase was responsible for a lot of disk traffic on my Mac/Catalina. It's been 12 days since I rebooted and Activity Monior is showing disk usage of 179.69 GB written and 152.19 GB read - during that time keybase has sent 1.1 MB over the network and received 96 MB, memory usage looks sane, cumulaltive CPU usage is OK, although as I type this, keybase is accounting for 80-120% of a CPU. This seems crazy to me.

I'm on Keybase 5.0.0-20191114182642+f73f97dac6 and MacOS 10.15.1

maxtaco commented 5 years ago

Can you do me a favor and post how big your logs are?

ls -lsah ~/Library/Logs/[Kk]eybase.*
Roger-Shepherd commented 5 years ago

Just checked my logs:

roger@Roger-TB Keybase (roger) % ls -lsah ~/Library/Logs/[Kk]eybase.* 104472 -rw-r--r-- 1 roger staff 51M 5 Dec 14:26 /Users/roger/Library/Logs/Keybase.app.log 10184 -rw-r--r-- 1 roger staff 4.8M 5 Aug 15:58 /Users/roger/Library/Logs/Keybase.app.log.1 8 -rw-r--r-- 1 roger staff 133B 22 Nov 16:09 /Users/roger/Library/Logs/Keybase.app.serverConfig 392 -rw------- 1 roger staff 132K 4 Dec 21:16 /Users/roger/Library/Logs/keybase.ek.log 163848 -rw------- 1 roger staff 71M 5 Dec 14:30 /Users/roger/Library/Logs/keybase.kbfs.log 262152 -rw------- 1 roger staff 128M 1 Apr 2019 /Users/roger/Library/Logs/keybase.kbfs.log-20190331T133342+0100-20190401T222147+0100 262152 -rw------- 1 roger staff 128M 10 Jun 04:31 /Users/roger/Library/Logs/keybase.kbfs.log-20190603T110914+0100-20190610T043142+0100 262152 -rw------- 1 roger staff 123M 5 Dec 14:31 /Users/roger/Library/Logs/keybase.service.log 262152 -rw------- 1 roger staff 128M 5 Dec 11:12 /Users/roger/Library/Logs/keybase.service.log-20191205T110430Z-20191205T111258Z 262224 -rw------- 1 roger staff 128M 5 Dec 11:25 /Users/roger/Library/Logs/keybase.service.log-20191205T111258Z-20191205T112506Z 8 -rw-r--r-- 1 roger staff 1.4K 21 Nov 14:16 /Users/roger/Library/Logs/keybase.start.log 43336 -rw-r--r-- 1 roger staff 20M 5 Dec 13:52 /Users/roger/Library/Logs/keybase.updater.log

maxtaco commented 5 years ago

Thanks! @Roger-Shepherd are you members of any big active open teams? The logging isn't great but likely only accounts for a minor part of the problem. The bigger issue is likely a bug in the indexer that we are hunting down. Thanks!

Roger-Shepherd commented 5 years ago

@maxtaco - not as far as I know - I'm running on two machines in my house, if that makes a difference - I did look at the other one and it shows a similar large consumption of disk I/O.

Roger-Shepherd commented 5 years ago

@maxtaco I am running iCloud, timemachine backups, BackBlaze backup and Spider Oak Hive on this machine

Roger-Shepherd commented 4 years ago

And I I've just notice KeyBase Help (Renderer) is using almost 2 GB of real memory.

yb66 commented 4 years ago

Hi,

I'm here because I noticed the large logs Keybase was making, similar sizes to Roger-Shepherd's above. I'm in the middle of setting up a dtrace on the CPU and disk writes as now I've noticed the above-what-I'd-expect CPU usage. If I find anything I'll post it here.

Quick question in the meantime: if I delete or rotate and archive the logs will that cause any problems with the app or the kbfs?

Mac Mojave version 10.14.6 Keybase version 5.1.1-20191211223249+15bbb94c23 Not a member of any teams.

Regards, iain