Severe Memory Leak: anytypeHelper fills RAM completely

bannert1337 commented 1 year ago

Have you read a contributing guide?

[X] I have read CONTRIBUTING.md
[X] I have searched the existing issues and didn't find any that were similar
[X] I have considered creating a pull request with fixes instead of a bug report and want to proceed

Current Behavior

When creating a new custom Type the unfolded list box displays all current Types available. After typing the name for a custom Type the unfolded list box shows a loading animation. This is enough to make my Laptop's fans spin up and when looking into Task Manager, the Anytype client takes all available RAM. This causes the system to slow down severely and will take some time to revert. After the search is finished, the client still takes up a lot of RAM. I have 64 GB of RAM installed on my system. After searching, the process anytypeHelper.exe still takes up ~30 GB of RAM. While searching, the process takes 54 GB of RAM and produces ~70-80% of CPU usage. I know that a bug report about a memory leak is already open, but I wasn't able to find a register function for the Anytype community forum.

Expected Behavior

The client should only take up a minimum amount of RAM and CPU usage.

Steps To Reproduce

Open Anytype client Click Library Focus the search field Enter a name

Environment

Edition Windows 11 Pro
Version 22H2
Installed on    ‎23.‎02.‎2023
OS build    22621.2134
Experience  Windows Feature Experience Pack 1000.22659.1000.0
Device name DESKTOP-8P8SG47
Processor   AMD Ryzen 5 5600H with Radeon Graphics 3.30 GHz
Installed RAM   64.0 GB (62.9 GB usable)
Device ID   8F896C85-ED23-417E-BC54-90FBE1EBFB70
Product ID  00330-80000-00000-AA334
System type 64-bit operating system, x64-based processor
Pen and touch   No pen or touch input is available for this display

Device: DESKTOP-8P8SG47
OS version: win32 x64 10.0.22621
App version: 0.34.3
Build number: build on 2023-08-16 11:07:20 +0000 UTC from  at #2815587c8afa3f81e75336226cacecb7fe105e9c(v0.27.21)
Library version: v0.27.21
Account ID: A6RddMdCq3c4yfsVSYhsVBu2FYEBoGUJze5r3LHfgoMdQdHp
Analytics ID: a614454c-efcd-4ee0-b995-6c1d38c157cd
Device ID: 12D3KooWRrC9GjVBLgAXo9x2dVHqKYKKJKE9wqwS3JAow9k8LY69

Anything else?

https://github.com/anyproto/anytype-ts/issues/209

bannert1337 commented 1 year ago

For details, check the original ticket.

bannert1337 commented 1 year ago

I used pmap to output the memory regions allocated, the size, permissions, and mapping location for the process anytypeHelper.

Fresh start

``` 12764: /tmp/.mount_anytypBlJ8Ls/resources/app.asar.unpacked/dist/anytypeHelper 127.0.0.1:0 127.0.0.1:0 Address Kbytes RSS Dirty Mode Mapping 0000000000400000 53824 41156 0 r-x-- anytypeHelper 0000000003a90000 3436 1144 180 rw--- anytypeHelper 0000000003deb000 2012 292 292 rw--- [ anon ] 0000000004568000 4 0 0 ----- [ anon ] 0000000004569000 4 4 4 rw--- [ anon ] 000000c000000000 65536 65420 65420 rw--- [ anon ] 000000c004000000 36864 1464 1464 rw--- [ anon ] 000000c006400000 81920 0 0 rw--- [ anon ] 000000c00b400000 32768 2208 2208 rw--- [ anon ] 000000c00d400000 20480 2048 2048 rw--- [ anon ] 000000c00e800000 8192 1024 1024 rw--- [ anon ] 000000c00f000000 45056 31616 31616 rw--- [ anon ] 000000c011c00000 10653696 51788 51788 rw--- [ anon ] 000000c29c000000 4096 0 0 rw--- [ anon ] 000000c29c400000 61440 0 0 ----- [ anon ] 00007f591fe00000 98664 360 0 r--s- 0000000003ef.zap 00007f592c253000 2304 2256 2256 rw--- [ anon ] 00007f592c493000 8 0 0 ----- [ anon ] 00007f592c495000 94640 93960 93960 rw--- [ anon ] 00007f5932669000 53460 52796 52796 rw--- [ anon ] 00007f5935aa4000 19824 19720 19720 rw--- [ anon ] 00007f5936e00000 131072 4 0 rw-s- 000005.vlog 00007f593ee0b000 2004 1988 1988 rw--- [ anon ] 00007f593f000000 4 4 0 rw-s- 000004.vlog 00007f593f002000 26972 26736 26736 rw--- [ anon ] 00007f5940a61000 5756 5728 5728 rw--- [ anon ] 00007f594187a000 91672 87552 87552 rw--- [ anon ] 00007f5947200000 34016 64 0 rw-s- 000001.vlog 00007f5949340000 768 768 768 rw--- [ anon ] 00007f5949400000 32768 4 0 rw-s- 00002.mem 00007f594b40b000 2004 1984 1984 rw--- [ anon ] 00007f594b600000 131072 80 0 rw-s- 00002.mem 00007f5953605000 19148 18956 18956 rw--- [ anon ] 00007f59548be000 21148 20828 20828 rw--- [ anon ] 00007f5955d67000 13964 13872 13872 rw--- [ anon ] 00007f5956b11000 5052 4944 4944 rw--- [ anon ] 00007f5957000000 32768 4 0 rw-s- 000005.vlog 00007f595900b000 2004 1988 1988 rw--- [ anon ] 00007f5959200000 4 4 0 rw-s- 000004.vlog 00007f5959205000 3560 3560 3560 rw--- [ anon ] 00007f5959589000 5224 5204 5204 rw--- [ anon ] 00007f5959aa4000 3732 3704 3704 rw--- [ anon ] 00007f5959e4f000 1088 1076 1076 rw--- [ anon ] 00007f5959f63000 2792 2792 2792 rw--- [ anon ] 00007f595a21e000 1536 1516 1516 rw--- [ anon ] 00007f595a3a6000 3432 3416 3416 rw--- [ anon ] 00007f595a700000 1024 64 0 rw-s- DISCARD 00007f595a800000 9904 9672 0 rw-s- 000001.sst 00007f595b1b0000 128 56 0 r--s- root.bolt 00007f595b1d0000 80 80 0 rw-s- 000004.sst 00007f595b1e4000 412 408 0 rw-s- 000002.sst 00007f595b24b000 116 116 0 rw-s- 000003.sst 00007f595b268000 1108 1108 1108 rw--- [ anon ] 00007f595b37d000 1024 64 0 rw-s- DISCARD 00007f595b47d000 256 256 256 rw--- [ anon ] 00007f595b4bd000 280 140 0 rw-s- 000003.sst 00007f595b503000 1012 828 0 rw-s- 000002.sst 00007f595b600000 2496 1700 0 rw-s- 000001.sst 00007f595b873000 64 64 64 rw--- [ anon ] 00007f595b883000 80 80 0 rw-s- 000004.sst 00007f595b897000 2984 2972 2972 rw--- [ anon ] 00007f595bb81000 8 0 0 ----- [ anon ] 00007f595bb83000 388 256 256 rw--- [ anon ] 00007f595bbe4000 8 0 0 ----- [ anon ] 00007f595bbe6000 132 8 8 rw--- [ anon ] 00007f595bc07000 8 0 0 ----- [ anon ] 00007f595bc09000 900 764 764 rw--- [ anon ] 00007f595bcea000 8 0 0 ----- [ anon ] 00007f595bcec000 132 8 8 rw--- [ anon ] 00007f595bd0d000 8 0 0 ----- [ anon ] 00007f595bd0f000 196 72 72 rw--- [ anon ] 00007f595bd40000 8 0 0 ----- [ anon ] 00007f595bd42000 388 256 256 rw--- [ anon ] 00007f595bda3000 8 0 0 ----- [ anon ] 00007f595bda5000 900 760 760 rw--- [ anon ] 00007f595be86000 8 0 0 ----- [ anon ] 00007f595be88000 132 8 8 rw--- [ anon ] 00007f595bea9000 8 0 0 ----- [ anon ] 00007f595beab000 388 260 260 rw--- [ anon ] 00007f595bf0c000 8 0 0 ----- [ anon ] 00007f595bf0e000 452 328 328 rw--- [ anon ] 00007f595bf7f000 8 0 0 ----- [ anon ] 00007f595bf81000 2064 1732 1732 rw--- [ anon ] 00007f595c185000 8 0 0 ----- [ anon ] 00007f595c187000 132 4 4 rw--- [ anon ] 00007f595c1a8000 8 0 0 ----- [ anon ] 00007f595c1aa000 388 260 260 rw--- [ anon ] 00007f595c20b000 8 0 0 ----- [ anon ] 00007f595c20d000 132 8 8 rw--- [ anon ] 00007f595c22e000 8 0 0 ----- [ anon ] 00007f595c230000 132 8 8 rw--- [ anon ] 00007f595c251000 8 0 0 ----- [ anon ] 00007f595c253000 132 4 4 rw--- [ anon ] 00007f595c275000 128 128 128 rw--- [ anon ] 00007f595c295000 1024 336 336 rw--- [ anon ] 00007f595c395000 1108 1108 1108 rw--- [ anon ] 00007f595c4aa000 1368 0 0 rw--- [ anon ] 00007f595c600000 30720 4 4 rw--- [ anon ] 00007f595e400000 680 0 0 rw--- [ anon ] 00007f595e4aa000 263680 0 0 ----- [ anon ] 00007f596e62a000 24 24 24 rw--- [ anon ] 00007f596e630000 524264 0 0 ----- [ anon ] 00007f598e62a000 24 24 24 rw--- [ anon ] 00007f598e630000 293544 0 0 ----- [ anon ] 00007f59a04da000 4 4 4 rw--- [ anon ] 00007f59a04db000 36692 0 0 ----- [ anon ] 00007f59a28b0000 4 4 4 rw--- [ anon ] 00007f59a28b1000 4580 0 0 ----- [ anon ] 00007f59a2d2a000 4 4 4 rw--- [ anon ] 00007f59a2d2b000 508 0 0 ----- [ anon ] 00007f59a2daa000 456 104 104 rw--- [ anon ] 00007ffe10376000 132 16 16 rw--- [ stack ] 00007ffe103cb000 16 0 0 r---- [ anon ] 00007ffe103cf000 8 4 0 r-x-- [ anon ] ffffffffff600000 4 0 0 --x-- [ anon ] ---------------- ------- ------- ------- total kB 13098844 598136 542280 ```

bannert1337 commented 1 year ago

crash_2023-08-24T08_14_56.log

deff7 commented 1 year ago

Hello! I bet you have large files that didn't fit within upload limits?

SNANA51832 commented 8 months ago

same here

deff7 commented 8 months ago

Hi! What version do you use?

SNANA51832 commented 8 months ago

Hi! What version do you use?

0.37.3

deff7 commented 8 months ago

Could you please give me information about how much memory anytype consumes?

Also please answer questions:

Do you have files that don't fit into upload limits?
Do you have a large number of objects?
Do you have objects with a large amount of text?
Or maybe you've noticed in which circumstances memory consumption has increased?

anyproto / anytype-heart