flatsurf / flatsurvey

4 stars 1 forks source link

Excessive RAM usage #1

Closed saraedum closed 3 years ago

saraedum commented 3 years ago

Some instances use lots of RAM. E.g. this invocation:

/tmp/ruth/miniconda/envs/survey/bin/python -m flatsurvey.worker log --output=ngon-2-3-5-7.log graphql orbit-closure pickle --base64 eJzFWAd0G8UWdSpk6SShhWK6Q7CkVVdoCSmQmIgwISACzrJarb0rSyu92ZVjA4ZQ1sL03nuvoffee8n/n8/vvffe25uZXasmcP6B/4/PWc97b+bNzJ1734y9dqLWV1Adu0IH9eEA/upTNd0OWP0ly5bS+JWgoxcmdGm22q8HqGn12wHTcvR+nUpFdUBXfAMmZiZ0dHSEYZILkwlMMYQdgakubEJgU8+OwTQXJAKbeXYCNndhCwJb6hkJTX1I1ZxuqqsF2Mqb03ZoRXMqVA/khi21aGqKVlBtW2q0YOuuzD6YYBFLQHC8rawxHUPRVFxeiQ4H9IJe1C1HdIdttPIwn4tNFeAthTVtaTzBIjFAgm01RclWzIJjWooi9euO6ji43+nNy6tYJlR0TFOmuo0jVcdE+CoW1XMVTZdghhjgrchElP3FSUtLprXAN2Cm6Fg0bQ27FAoS+yhF3TFKOQm2M5p/WhMX1f6iaiuqlVPUXM50zEFdET5pGf8138rN9wLCIcH2s0dghyrsSGCnzGaIpMBPHTJLRZiV2Rw9C03crJmtsFGwcxV2IbCrMSszHUN+svm2XdJMlffYrQqdBHZv6rGgVCxWHNFjjyrsSWAv7LFlXY+Vlung+e9dhX0I7ItBtpr6xF1VmE1gP4xsVTdsiTWoU1uHOVXYn0A3Rqdi1EsWqEKQQMibKV1apdPSQnPQtEvUBrkKYQIRb6b6BUarECMQb4uxrTs2o5e0AhsSJBC+ZBVSBOZiok0x0RKrz8TZdTigCgcSOGgUDnbhkBGYV4X5BA7NbMH43sDKBaOwkMCiUVicTqcdOIzA4bNPhyU4+SeyFVewtJmQKGWHEapft3SKSvFspWKVTW2ggJTsadGYP6ZQKg1Uykp/oZRVCxIckUnhautqgFUpZnWq9Jl6IddopLmxmLUVdiIogjAscyFN4MieaT0TR2F5QzWhXCdqQQyXiGfyBBIchSdN6ruXS4Vhq1Q0EYhaU6klKWBBkpZvMAIruj5FNowpGlZADkuJSj5iSi0xwT4SHN1lEF7HhmClC8ekxxw4lkCmF45ru0dRMsctWMXHGnC8CycQ6DWEHYLVLigETkR7EtrdcQ1UF7IENGOVgbEcAR1jEzFWVKHPhX4ChgiZBPIYmsyGyZEwDLhQIFAUQYtAyRvnJKDsAhCgImQTcPzpcgAVFwYJrBGxIQLD3rCIBSe5cDKBU0RohMCpXqjbgNNcWEvgdBE6g8CZ3oZkOMsFl8CoPoYAVQmczd0ajLlwjoGVu5PpuNCvZ6lqaozOgj4NFRzOrUcUIKtSqXWMBOcZ040ZxkxeGUOeFLnUEXM4vwoXELjQmGWgtC8icLGBsrzEhUtH4LIqXE7gCl7pyiqtqfLKUbiKwNWjcE06bZznwLUErkNWXv8Jy5HghjY90ouGHN1iaxm/X27cSKLDmHRVRkG4yejpMo40liPjjBVdxjjzhuFmF25hzLuVwG29cHsX4o+EuoPAneIk7iJwdx2V7nHhXgL3idj9BNbVqPSACw8SeEiEHibwSD2VHnXhMQKPi+ATBJ6sUekpF54m8IwIPUvguToqPe/CCwReFLGXCLxco9IrLrxK4DURep3AGzUqvenCWwTeFqF3CLyLLSTRewTe5yT6gMCHfPsqrHfhC2ljfXoMS+YXR+BLmSmMW4auDcBHY7YDXybwcbuTIKUSov+VjaBfU/vRVNUG2Cvnqwx7RPlrHspfJ/ANschvEvhWHcrfduE7BL4rYt8j8P0ayj9w4YcEfiRCPybwk3qUf+rCzwj8XAR/QeCXNZR/5cKvCfxGhH5L4Hd1KP/ehT8Q+KOI/YnAn2so/8WFvxL4mwj9ncA/aij/04V/Efg3D9EOhJPQCfjlWNOJ3J6EX4Y4nczNKfh16VTe3gS/DVUOWa8Uy32mpCgaGo6uKEwJS/CJSAc9gXq0968GWaKb/jdp/PEhiU7D8T3zxkapxFe12QbS0aZ04p6qy7P5pxzYPP8WYn5+hCS9cCXdEh1VuhVfzdb4zWzDamBg0ErmnFw2WkzmndC8EN2Gjeus0m15x+n4zbMl5JvyLaQzeL6ZvNt2bfPZNubb3su3A++4Ix+0E2/PYpEJVbozt3bB7yjdlbd3a9rzBq91xXupSHXXu3+UatYuFSqOLtFORp6P/fJkrHTp7ujB2kT34NPtid9euhd+uwTn9ubufcY5ty+3u3zOzebmfnzBc3h7f97u5u0A52KQt0PcL7NEY6wS0DA2R2iEOT46Gy/yKO8WY/ahozTOowmOUZJHUtwzl8HLbgwlywRv5egBDCGtXB4exue3ZZ7E7258OLD3AEIW0HTGk9oLoY+WiornpAeODw70Z72XG4940B047pk7tw7YgyV6EF/OwQwp/o4VNxI9hLvnjbttA/05Oh8d5zBpru3g1S+r2qZND+VoL2CdR+hC9isvOk7kHRm/Bkzc4iJ/0/7DhC5mHpYI5VbR6WEMtbMqI/TwuiSTWJI8HzuVj7VypSJdwmyW2dZxXUvRWrZmSkXnLkYx2sN3cIQ/AScXXcad6brsk8eXiH/l6fRIfrCZaezJjDDhkx9TLWdJFqPreDmQSsnReDISC8dSoVA8FYpGEtFwJBmOxBJJOZSKR2LxRDIUi0ZT6ApHsFsyGuqcE+zujAXCKb07Fu2lR7F8m7AabVrsNUgJcxB2m6yW453dnXJiP2xFO+d0ynKKNcPojEbDrInJOlORGDaTrKccZt44OhNyFFtRdIZDrBVmwxN0BcvN9oN/LWr8cUKP5sKv2BX+BtFKel+fqZl47DZdyY/yGHGUx/Ljn8H6cJ6Jd4pfkSi7Fns68oIqx7GKwiDtmWzn2TlmTFb6E0GxlxguJhyOBCNsZXIEF5mQI15Mxlg0Hk2IYIptNRSOiWACY/FUTBaxGNtxWA6JWITjIwy6CqdE4hzPj1Ys6YSWJS1lSwr72EZkH1o5FfGhjcsRH9pQJOFBm0wkPWgjoYgHbThBe9mceqWXruZAbT8OVNAZLut2sKgX2X8EjHKZKmz6mQ3/eAiKvjx8Iguz8Xq3ajmmFkQR9g0NKX4XqrJKVaVZXkI0/NqjNIe/sgb+5UZ1tlNRWPpYk9WSPKsJeSHv/mZ5G9xtNss731beA5wTBcGJIgc4307eVou8S43yLvvyhrokQt5Wk7xpg7ztVnk7fAeVRnkPcueauuxN8h5qJ+/hz1jeJzXL++TPUd6ntMp7ZMPyPpUf5WniKNduXN6nC3kLqpzByJT3tMTOMWMxLcWCMS4NsZlYKijLsbi/o1go4YfZrhDEYDiZ8ncWlVOeyXYXTSYS/mC2Rzmekn2b7TQVjCfpmULjZ/HzFetyW9Z1In/geoWGlZ2kV2YiQtNehBWdSCRVqznhVLJWciJyMOzXm5Q3hJcbr9qMCuXnV/OLvcpVebZQ5di4Ks+pqfLcdqo8r1mV53P3Bc2qvLCtKi/iR3kxH3IJR+TCdqK8tEWUlzWK8nIhSrUmrSt4zisbpXUVd15dN9GkRmld005a137G0rquWVrXf47SuqFVWjduWFo38fO4mcN0y8aVdatQljju2xghGKI9k+z85f8nZd3O+Kz6fL6D8/lOwee7xvl8d43P97Tj873NfL6Pu+9v5vO6tnx+gOP3oChND3GerWtH6IdbCP1II6Ef9W+Zx+qSiFvm4aZb5vGGW+aJ1lvmSb6Dpxql8DR3PlOXvemWebadFJ77jKXwfLMUXvgcpfBiqxRe2rAUXuZH+Yo4ylc3roXXhBYEVV6vw3QKPzEO5fr8c/5ByfqcEH2DcY5vl/1XQu2W6ZvM460ozwmwGgnwFk8nUr/NeqzzLopH/2cXxTsNF8W7XFjvCWG9z4Tl0A945EMeWY/fwH8APZfDKA==

goes up two 12GB after two hours.

This might be a memory leak.