-
Currently, a synchronous task runs in its own thread (since v2.13.0 / PR #1160). As discussed in #1156, we should evaluate whether we want to run a synchronous task in its own subprocess.
Advantage…
-
Python workers leverage `setproctitle` to update the process title to something like `ray::IDLE` or `ray::IDLE_SpillWorker`. Sometimes we need to match the titles of processes returned from `psutil.pr…
-
### Describe the issue
After installing kestra in independent services mode (not standalone), messages like
`com.zaxxer.hikari.pool.PoolBase HikariPool-1 - Failed to validate connection org.postgr…
-
### Proposal to improve performance
currently, `LLMEngine` (driver) lives in the same process as tensor parallel rank 0 process, which caused a lot trouble for us, e.g. we cannot easily create two in…
-
This thing needs a system to run deferred tasks in the background. It can be very simple at first - e.g. just an event responder that can run async in the same process as web server? Maybe better to s…
-
**my code:**
**I used nohup Python worker. py to start the worker**
`
ps -aux | grep "worker.py"
…
-
Ceiling of number of RUNNING processes in total on a worker. The purpose would be to have a predictable limit/cap on the CPU and/or memory usage on a worker, at any given time.
So for example, if …
-
### Anything you want to discuss about vllm.
Here is a simple example to run vLLM.
When I add `import multiprocessing` and set `tensor_paralle_size > 1 `(in my code, the value is 2), I meet annoy…
-
### Search before asking
- [X] I searched the [issues](https://github.com/ray-project/ray/issues) and found no similar issues.
### Ray Component
Ray Core
### Issue Severity
Medium: It contribute…
-
Hello everyone,
My team seems to have stumbled upon a really weird issue with the conductor python sdk where the memory of the worker continues to climb until the worker runs out of resources (in …