Fix slow memory leak while an actor stays active

[nox213]

See problem described here: https://developers.portone.io/blog/posts/2024-02/v2-oom