search

jazelly / FinetuneLLMs

Easy and Fast LLM finetuning on GPU or CPU.
MIT License
39 stars 8 forks source link

Idle worker should be closed within 10 seconds #5

Open jazelly opened 3 months ago

jazelly commented 3 months ago

Right now, once a worker thread is spawned and finished a task. It keeps polling for tasks and will never stop.

This consumes CPU resources and we should close a worker when it's idle within a certain amount of time