[core][ref counting] Borrowed objects not cleaned up

[rickyyx]

What happened + What you expected to happen

When actor creation tasks (__init__) takes in object references, it seems they are not cleaned up properly.

Versions / Dependencies

master

Reproduction script

https://github.com/ray-project/ray/pull/32945/files

Issue Severity

None

[stale[bot]]

Hi, I'm a bot from the Ray team :)

To help human contributors to focus on more relevant issues, I will automatically add the stale label to issues that have had no activity for more than 4 months.

If there is no further activity in the 14 days, the issue will be closed!

• If you'd like to keep the issue open, just leave any comment, and the stale label will be removed!
• If you'd like to get more attention to the issue, please tag one of Ray's contributors.

You can always ask for help on our discussion forum or Ray's public slack channel.