Zenoblend and FLIP using over 100GB of ram

[Geramy]

Hey I have been testing the system and it seems to use over 100GB of ram in my environment and causes the system to nearly crash. So far here is my config, please if you can think of something let me know.

[zhxx1987]

I am not clear if that's a problem of blender, but such small sim in zeno wouldn't take too much ram.

yubin, what's your opinion?

On Fri, Apr 1, 2022 at 7:41 AM Geramy @.***> wrote:

Hey I have been testing the system and it seems to use over 100GB of ram in my environment and causes the system to nearly crash. So far here is my config, please if you can think of something let me know.

[image: image] https://user-images.githubusercontent.com/264964/161166851-76870d99-9e2d-4ba3-b172-cf03028745db.png

— Reply to this email directly, view it on GitHub https://github.com/zenustech/zenoblend/issues/21, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC5IJSY52NY4M4JCXBYU6WDVCYZZZANCNFSM5SHA5BAQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

[zhxx1987]

couple things to check: are you using a very small dx? can you tell us your water size and the dx you used for the sim? is this 100GM thing a growing thing from the beginning of simulation or it's just a stable 100GB usage? during the process, are you using and zeno cacheOut nodes? our cachOut node cache things in the ram instead of disk. (use writeVDB instead)

thank you

On Fri, Apr 1, 2022 at 12:44 PM Xinxin Zhang @.***> wrote:

I am not clear if that's a problem of blender, but such small sim in zeno wouldn't take too much ram.

yubin, what's your opinion?

On Fri, Apr 1, 2022 at 7:41 AM Geramy @.***> wrote:

Hey I have been testing the system and it seems to use over 100GB of ram in my environment and causes the system to nearly crash. So far here is my config, please if you can think of something let me know.

[image: image] https://user-images.githubusercontent.com/264964/161166851-76870d99-9e2d-4ba3-b172-cf03028745db.png

— Reply to this email directly, view it on GitHub https://github.com/zenustech/zenoblend/issues/21, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC5IJSY52NY4M4JCXBYU6WDVCYZZZANCNFSM5SHA5BAQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

[Geramy]

couple things to check: are you using a very small dx? can you tell us your water size and the dx you used for the sim? is this 100GM thing a growing thing from the beginning of simulation or it's just a stable 100GB usage? during the process, are you using and zeno cacheOut nodes? our cachOut node cache things in the ram instead of disk. (use writeVDB instead) thank you On Fri, Apr 1, 2022 at 12:44 PM Xinxin Zhang @.> wrote: … I am not clear if that's a problem of blender, but such small sim in zeno wouldn't take too much ram. yubin, what's your opinion? On Fri, Apr 1, 2022 at 7:41 AM Geramy @.> wrote: > Hey I have been testing the system and it seems to use over 100GB of ram > in my environment and causes the system to nearly crash. > So far here is my config, please if you can think of something let me > know. > > [image: image] > https://user-images.githubusercontent.com/264964/161166851-76870d99-9e2d-4ba3-b172-cf03028745db.png > > — > Reply to this email directly, view it on GitHub > <#21>, or unsubscribe > https://github.com/notifications/unsubscribe-auth/AC5IJSY52NY4M4JCXBYU6WDVCYZZZANCNFSM5SHA5BAQ > . > You are receiving this because you are subscribed to this thread.Message > ID: @.***> >

I am using CacheOnce on both particle and world, the water size is 49m x 72m x 12m and the dx value is 0.100.

The RAM eventually hits something like 127GB and then it dropped but I'm not sure if that's because windows decided to dump ram to disk or what. but when blender dropped to about 32MB all my other programs did too and it was super slow. It seemed the ram was still being used and that maybe the OS was doing some type of swapping to fix the RAM usage. So I would assume it wanted to grow more even. What settings would give me a crappier quality simulation but use less ram and process faster? I don't mind having bad quality if I can use the simulation system because I can always tweak it later. Also there is no good instruction on making a "Domain" Zone, or doing walls/collisions.

[archibate]

So memory actually gradually grows to 128gb right? Ths might because Zenoblend is 'caching the result for every frame', which is in ram.. This feature is mean to allow you to playback from frame 1 again, without having to re-run the simulation. To disable cache, press 'n' in the node editor, in the menu disable the 'cached' option on NodeTree, so that everything will be on-the-fly without extra ram.. Also, are you dumping the result particles or surface to Blender? If you still need cache, may dump surface instead of particles to save some memory.

无法顺畅的大口呼吸，是活着的最好证明

---Original--- From: @.> Date: Fri, Apr 1, 2022 13:24 PM To: @.>; Cc: @.***>; Subject: Re: [zenustech/zenoblend] Zenoblend and FLIP using over 100GB of ram (Issue #21)

couple things to check: are you using a very small dx? can you tell us your water size and the dx you used for the sim? is this 100GM thing a growing thing from the beginning of simulation or it's just a stable 100GB usage? during the process, are you using and zeno cacheOut nodes? our cachOut node cache things in the ram instead of disk. (use writeVDB instead) thank you On Fri, Apr 1, 2022 at 12:44 PM Xinxin Zhang @.> wrote: … I am not clear if that's a problem of blender, but such small sim in zeno wouldn't take too much ram. yubin, what's your opinion? On Fri, Apr 1, 2022 at 7:41 AM Geramy @.> wrote: > Hey I have been testing the system and it seems to use over 100GB of ram > in my environment and causes the system to nearly crash. > So far here is my config, please if you can think of something let me > know. > > [image: image] > https://user-images.githubusercontent.com/264964/161166851-76870d99-9e2d-4ba3-b172-cf03028745db.png > > — > Reply to this email directly, view it on GitHub > <#21>, or unsubscribe > https://github.com/notifications/unsubscribe-auth/AC5IJSY52NY4M4JCXBYU6WDVCYZZZANCNFSM5SHA5BAQ > . > You are receiving this because you are subscribed to this thread.Message > ID: @.***> >

I am using CacheOnce on both particle and world, the water size is 49m x 72m x 12m and the dx value is 0.100.

The RAM eventually hits something like 127GB and then it dropped but I'm not sure if that's because windows decided to dump ram to disk or what. but when blender dropped to about 32MB all my other programs did too and it was super slow. It seemed the ram was still being used and that maybe the OS was doing some type of swapping to fix the RAM usage. So I would assume it wanted to grow more even. What settings would give me a crappier quality simulation but use less ram and process faster? I don't mind having bad quality if I can use the simulation system because I can always tweak it later. Also there is no good instruction on making a "Domain" Zone, or doing walls/collisions.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.***>

[Geramy]

I'm not sure if this is right. Let me know what you think. @archibate it grows to the maximum ram I have available and then causes operating system swap. I'm not using any cache and I only have it set for one frame. I am not sure what I'm dumping just trying to do my best to make the nodes.

[Geramy]

@archibate here is another screenshot of debugging