[CI] `linux://rllib:test_memory_leak_ppo` is failing/flaky on master.

[cadedaniel]

• 98da294f0b8fbf0ab9d94ebd552c4d78b4d3aaf8 FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• 182744bbd151c166b8028355eae12a5da63fb3cc FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• 182744bbd151c166b8028355eae12a5da63fb3cc FAILED Buildkite :brain: RLlib: Memory leak tests PyTorch
• 37de814a8598e0ea3dea23d5ae0caf9df54fa0e6 FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• 37de814a8598e0ea3dea23d5ae0caf9df54fa0e6 FAILED Buildkite :brain: RLlib: Memory leak tests PyTorch
• 875193ca8d4720a7215aad2a275851f5157674c2 FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• 875193ca8d4720a7215aad2a275851f5157674c2 FAILED Buildkite :brain: RLlib: Memory leak tests PyTorch
• 824c79011e32fa4a0e9c409ef55a62a05fb70da8 FAILED Buildkite :brain: RLlib: Memory leak tests PyTorch
• 824c79011e32fa4a0e9c409ef55a62a05fb70da8 FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• 7a50e23478a32687e87528b2fbdae3ce953ae579 FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• 7a50e23478a32687e87528b2fbdae3ce953ae579 FAILED Buildkite :brain: RLlib: Memory leak tests PyTorch
• 161567dbd93f94bef941c17779d3880f310a0373 FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• 161567dbd93f94bef941c17779d3880f310a0373 FAILED Buildkite :brain: RLlib: Memory leak tests PyTorch
• e5e3f30dd8dcfe868313e5c3ff5793b21837b6ef FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• e5e3f30dd8dcfe868313e5c3ff5793b21837b6ef FAILED Buildkite :brain: RLlib: Memory leak tests PyTorch
• 6e1ac50716663f5d35bdb5f2bf9b1e88e5b7a3f5 FAILED Buildkite :brain: RLlib: Memory leak tests PyTorch
• 6e1ac50716663f5d35bdb5f2bf9b1e88e5b7a3f5 FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing
• ee4b23a91008f6784643ba3b11b7a1b0e13c434b FAILED Buildkite :brain: RLlib: Memory leak tests TF2-eager-tracing

.... Generated from flaky test tracker. Please do not edit the signature in this section. DataCaseName-linux://rllib:test_memory_leak_ppo-END ....

[kouroshHakha]

All mem leak failures so far are non-blocking for any release. We are chatting with the team on how to deflake these tests but have not come up with a graceful solution yet.

[cadedaniel]

Ok, thanks for the context. Can we downgrade this from P0 and keep it open so future oncalls can see this?