search

josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
https://www.rwkv.com
MIT License
5.05k stars 481 forks source link

服务启动成功，但是访问报500 #342

Closed lascyb closed 3 months ago

lascyb commented 3 months ago

image

lascyb commented 3 months ago

--- 0.8576188087463379 seconds --- INFO: Started server process [22196] INFO: Waiting for application startup. torch found: G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages\torch\lib torch set INFO: Application startup complete. INFO: Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit) INFO: 127.0.0.1:31858 - "GET / HTTP/1.1" 304 Not Modified INFO: 127.0.0.1:31858 - "GET /status HTTP/1.1" 200 OK INFO: 127.0.0.1:31858 - "OPTIONS /update-config HTTP/1.1" 200 OK INFO: 127.0.0.1:31857 - "OPTIONS /switch-model HTTP/1.1" 200 OK state not loaded Updated Model Config: max_tokens=4100 temperature=1.0 top_p=0.3 presence_penalty=0.0 frequency_penalty=1.0 penalty_decay=None top_k=None global_penalty=None state=None INFO: 127.0.0.1:31857 - "POST /update-config HTTP/1.1" 200 OK Strategy Devices: {'cuda'} state cache enabled G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages_distutils_hack__init.py:11: UserWarning: Distutils was imported before Setuptools, but importing Setuptools also replaces the distutils module in sys.modules. This may lead to undesirable behaviors or errors. To avoid these issues, avoid using distutils directly, ensure that setuptools is installed in the traditional way (e.g. not an editable install), and/or make sure that setuptools is always imported before distutils. warnings.warn( G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages_distutils_hack\init.py:26: UserWarning: Setuptools is replacing distutils. warnings.warn("Setuptools is replacing distutils.") cannot import name 'packaging' from 'pkg_resources' (G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages\pkg_resources\init.py) Traceback (most recent call last): File "G:\AI\RWKV-Runner-Backend\backend-python\routes\config.py", line 73, in switch_model RWKV(model=body.model, strategy=body.strategy, tokenizer=body.tokenizer), File "G:\AI\RWKV-Runner-Backend\backend-python\utils\rwkv.py", line 644, in RWKV from rwkv_pip.model import ( File "G:\AI\RWKV-Runner-Backend\backend-python\rwkv_pip\model.py", line 84, in from torch.utils.cpp_extension import load File "G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages\torch\utils\cpp_extension.py", line 25, in from pkg_resources import packaging # type: ignore[attr-defined] ImportError: cannot import name 'packaging' from 'pkg_resources' (G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages\pkg_resources\init__.py)

INFO: 127.0.0.1:31858 - "POST /switch-model HTTP/1.1" 500 Internal Server Error

josStorer commented 3 months ago

https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/15863

./py310/python -m pip install setuptools==69.5.1

lascyb commented 3 months ago

解决了，谢谢