search

gpustack / gpustack

Manage GPU clusters for running LLMs
https://gpustack.ai
Apache License 2.0
691 stars 56 forks source link

Legacy worker processes remain after uninstalling or upgrading GPUStack on macOS #204

Open linyinli opened 3 months ago

linyinli commented 3 months ago

Describe the bug Legacy worker processes remain after uninstalling or upgrading GPUStack on macOS (not necessarily occurring):

sudo /var/lib/gpustack/uninstall.sh

ps -ef | grep gpustack
    0  9525     1   0 Tue05PM ??         0:00.02 /Users/seal/.local/pipx/venvs/gpustack/bin/python -c from multiprocessing.resource_tracker import main;main(6)
    0  9526     1   0 Tue05PM ??        11:00.35 /Users/seal/.local/pipx/venvs/gpustack/bin/python -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=7, pipe_handle=9) --multiprocessing-fork
  501 24836 24747   0 10:19AM ttys005    0:00.00 grep --color=auto --exclude-dir=.bzr --exclude-dir=CVS --exclude-dir=.git --exclude-dir=.hg --exclude-dir=.svn --exclude-dir=.idea --exclude-dir=.tox gpustack
(base)

After installing or updating to a new version:

ps -ef | grep gpustack
    0  9525     1   0 Tue05PM ??         0:00.02 /Users/seal/.local/pipx/venvs/gpustack/bin/python -c from multiprocessing.resource_tracker import main;main(6)
    0  9526     1   0 Tue05PM ??        11:04.78 /Users/seal/.local/pipx/venvs/gpustack/bin/python -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=7, pipe_handle=9) --multiprocessing-fork
    0 25031     1   0 10:25AM ??         0:08.50 /Users/seal/.local/pipx/venvs/gpustack/bin/python /Users/seal/.local/bin/gpustack start
    0 25045 25031   0 10:25AM ??         0:00.02 /Users/seal/.local/pipx/venvs/gpustack/bin/python -c from multiprocessing.resource_tracker import main;main(6)
    0 25046 25031   0 10:25AM ??         0:02.32 /Users/seal/.local/pipx/venvs/gpustack/bin/python -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=7, pipe_handle=9) --multiprocessing-fork
    0 25247 25046   0 10:31AM ??         0:05.98 /Users/seal/.local/pipx/venvs/gpustack/bin/python -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=7, pipe_handle=14) --multiprocessing-fork

The remaining processes can interfere with the model instance’s status, preventing GPUStack from obtaining the correct model instance status:

image

Environment

Finenyaco commented 1 week ago

Cannot not be reproduced on main df21c4b

Finenyaco commented 4 days ago

GPUStack: main 31fa6d1

Occasionally, this issue is encountered during upgrades, but no specific reproduction method.

image
Finenyaco commented 11 hours ago

GPUStack version: main bb225f0

This issue can still be reproduced in the latest version.

Image