Ray memory issue when running rnd ppo

[leonard-q]

Describe the bug Ray memory issue occurred when running rnd ppo on montezuma's revenge of Atari env.

To Reproduce Run rnd ppo on montezuma's revenge

Expected behavior Memory issue occurs

Screenshots

Development Env. (OS, version, libraries): Linux Ubuntu, Python 3.8, requirement (jorldy0.0.2)

Additional context Add any other context about the problem here.

[leonard-q]

It happened again on 22,000,000 step when running rnd_ppo

[leonard-q]

[leonard-q]

It is not occurred again when debugging rnd recently. It can be closed now