django-cms / django-filer

File and Image Management Application for django
https://django-filer.readthedocs.io/
Other
1.73k stars 575 forks source link

Memory Leak during Image selection pop-up #1311

Closed unluckynelson closed 1 year ago

unluckynelson commented 1 year ago

I am on the latest version of django-filer as well as related packages.

Here are my package versions: requirements-common.txt

Whenever I open the pop-up to select an image the pop-up consumes around 500mb of RAM and does not release it after closing the pop-up. The same behaviour is noted on changing pages. I have a fairly large amount of photo's in a folder that opens up as around 134 pages of images.

It is impossible to get past page 3 as by then the 2gb of the docker instance has been consumed and the server crashes. Adding ram is an option but with 500mb a call this is not a realistic solution.

I use S3 as storage and gunicorn (20.0.4) to serve my app.

I am at a loss here, I'll setup some profilers and see what I can find but besides migrating away from django-filer (I am considering this as a lost resort) what could I do to solve this issue?

unluckynelson commented 1 year ago

The workaround we made was to run a script that updates the images table and moves all the unsorted images into separate folders. Smaller folders seems to have solved out issue, and pages load much faster.