ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
33.23k stars 5.62k forks source link

[aDAG][Core] Garbage collect channel related info when multi node is used #47576

Open rkooo567 opened 2 weeks ago

rkooo567 commented 2 weeks ago

What happened + What you expected to happen

  io_contexts_.push_back(std::make_unique<instrumented_io_context>());
  instrumented_io_context &io_context = *io_contexts_.back();
  io_works_.push_back(
      std::make_unique<
          boost::asio::executor_work_guard<boost::asio::io_context::executor_type>>(
          io_context.get_executor()));

As an example the following attributes are not cleaned when a channel is closed and finished.

Versions / Dependencies

master

Reproduction script

n/a

Issue Severity

None

anyscalesam commented 2 weeks ago

@rkooo567 needed for Beta?

rkooo567 commented 2 weeks ago

I don't think so. it may have some memory leak, but it would be minor