hollowaykeanho commented 1 year ago

Description

Please provide a short description of what feature you're looking forward to
enhance below. Please include the story behind your idea as well to give a
better visualization of your idea.

Follow up with Bep and his latest release about Go's LRU optimization. It has the ability to garbage collect at will to reduce the memory consumption down effectively.

Discussion: https://discourse.gohugo.io/t/how-to-instruct-hugo-pipe-not-to-cache/44467/3

UPDATE:

It was detected that some part of the contents in hestiaHUGO is holding up the memory but inaccessible, behaving like a "memory leak".

Expected Behavior

Please specify the expected behavior of your requested enhancement. Some great
and helpful pointers are your expected interface (e.g. command patterns,
simple sketches of the user interface, etc).

Lower memory consumption usage.

Current Behavior

Please specify the current behavior (e.g. workaround, blockage, etc).

Hugo + Blink Engine Brower + Gecko Engine Browser can really saturate the RAM easily when used simultenously for building the page contents.

Using ZORALab's Hestia 1.2.0 with the following stat:

Start building sites … 
hugo v0.111.3-5d4eb5154e1fed125ca8e9b5a0315c4180dab192 linux/amd64 BuildDate=2023-03-12T11:40:50Z VendorInfo=gohugoio

                   | EN   
-------------------+------
  Pages            |   6  
  Paginator pages  |   0  
  Non-page files   |  97  
  Static files     | 574  
  Processed images |  27  
  Aliases          |   0  
  Sitemaps         |   0  
  Cleaned          |   0  

Built in 6503 ms
Watching for changes in /home/u0/Documents/zoralab/Hestia/{hestiaHUGO,sites}
Watching for config changes in /home/u0/Documents/zoralab/Hestia/sites/config/_default, /home/u0/Documents/zoralab/Hestia/sites/config/development, /home/u0/Documents/zoralab/Hestia/hestiaHUGO/config/_default, /home/u0/Documents/zoralab/Hestia/hestiaHUGO/config/development
Environment: "development"
Serving pages from memory
Web Server is available at http://localhost:8080/ (bind address 127.0.0.1)
Press Ctrl+C to stop

Memory consumption is at: (about 240MB, 2% of 12GB RAM)

Attachment

Please drag and drop the necessary data files (e.g. screenshot, logs, etc)
below.

hollowaykeanho commented 1 year ago

Pending Hugo release of feature.

hollowaykeanho commented 1 year ago

Attempted 7811dcd9927174da9bc4572fa9f6150cf6babc40 first patch to observe for same pattern.

hollowaykeanho commented 1 year ago

Attempted 0ac8d8ae8d7e18e81d143f80e4bb489ec613ad95 second patch to observe for same pattern. Automation and cached .Contributors data are completely removed.

hollowaykeanho commented 1 year ago

Shown positive sign. Memory caching capability positively have to be removed. Can't use Hugo's .Store feature.

hollowaykeanho commented 1 year ago

Memory did return back to its initial position rather than holding up similar to memory leak. Observe more once the remaining spec documentations are ported safely without needing more patches.

hollowaykeanho commented 1 year ago

When refactoring at rapid speed, Hugo tends to occupy so much memory (upto 50% of 12GB) per its rendering and it looks like the garbage collection is very slow. We need a way to profile the memory hold up.

hollowaykeanho commented 1 year ago

Applying 3rd attempt here 54400224919d902e438320e82cad33f44cef7d6f. Hugo server have to be killed periodically in order to keep the memory consumption at the sane level.