Open hdoupe opened 4 years ago
I think this is a memory issue related to using the CPS and behavior parameters at the same time. behresp
makes copies of the Calculator
objects which makes the sims using behavior take longer and require significantly more memory.
I increased Tax-Brain's server size from 2 CPU and 13 GB RAM to 4 CPU and 26 GB RAM, and bumped the time limit from 600 seconds to 1200 seconds. Sims using the CPS and behavior parameters can be run successfully now.
Thanks for the report, @hdoupe. Seems like memory usage is going to be a recurring issue with behavior simulations with the CPS. I'm not sure what the long term solution to this is, but for now throwing more computing resources is probably our best bet. I'll see if I can think of something better for the long term
Agreed. The bright side of the beefier servers is that the regular sims using the PUF without behavior params are completeing in about 150-180 secs instead of 300. Here's a breakdown of the approximate sim times:
data source | static | behavioral |
---|---|---|
cps | 290 | 450 |
puf | 160 | 300 |
I don't know the full rationale for why behresp
makes copies of the Calculator
objects, but if we were able to toggle that off, we could save about 4-5 GB on behavior sims.