Open Lareina2441 opened 5 days ago
/home/w/.local/lib/python3.10/site-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension: '/home/w/.local/lib/python3.10/site-packages/torchvision/image.so: undefined symbol: _ZN3c1017RegisterOperatorsD1Ev'If you don't plan on using image functionality from torchvision.io
, you can ignore this warning. Otherwise, there might be something wrong with your environment. Did you have libjpeg
or libpng
installed before building torchvision
from source?
warn(
Models: ['llavamed']
worker_addr:
sudo apt-get update sudo apt-get install libjpeg-dev libpng-dev
2024-09-16 19:44:48 | ERROR | asyncio | Task exception was never retrieved future: <Task finished name='3xsew8gxluf_11' coro=<Queue.process_events() done, defined at /home/w/.local/lib/python3.10/site-packages/gradio/queueing.py:343> exception=1 validation error for PredictBody event_id Field required [type=missing, input_value={'fn_index': 11, 'data': ...on_hash': '3xsew8gxluf'}, input_type=dict] For further information visit https://errors.pydantic.dev/2.9/v/missing> Traceback (most recent call last): File "/home/w/.local/lib/python3.10/site-packages/gradio/queueing.py", line 347, in process_events client_awake = await self.gather_event_data(event) File "/home/w/.local/lib/python3.10/site-packages/gradio/queueing.py", line 220, in gather_event_data data, client_awake = await self.get_message(event, timeout=receive_timeout) File "/home/w/.local/lib/python3.10/site-packages/gradio/queueing.py", line 456, in get_message return PredictBody(**data), True File "/home/w/.local/lib/python3.10/site-packages/pydantic/main.py", line 209, in init validated_self = self.__pydantic_validator__.validate_python(data, self_instance=self) pydantic_core._pydantic_core.ValidationError: 1 validation error for PredictBody event_id Field required [type=missing, input_value={'fn_index': 11, 'data': ...on_hash': '3xsew8gxluf'}, input_type=dict] For further information visit https://errors.pydantic.dev/2.9/v/missing
w@w-Precision-7960-Tower:~$ python3 -m llava.serve.test_message --model-name llava-med-v1.5-mistral-7b --controller http://localhost:10000 Models: ['llavamed'] worker_addr:
bash 复制代码 python3 -m llava.serve.controller --host 0.0.0.0 --port 10000 启动后,你应该看到类似以下的输出:
arduino 复制代码 INFO: Uvicorn running on http://0.0.0.0:10000
bash 复制代码 sudo lsof -i :10000 sudo lsof -i :40000 如果端口被占用,你可以更改端口号,重新启动 controller 和 model_worker,并指定不同的端口,例如:
bash 复制代码 python3 -m llava.serve.controller --host 0.0.0.0 --port 11000 python3 -m llava.serve.model_worker --host 0.0.0.0 --controller http://localhost:11000 --port 41000 --worker http://localhost:41000 --model-path microsoft/llava-med-v1.5-mistral-7b --multi-modal
检查日志文件或控制台输出 如果 worker 连接不上 controller,通常会有错误日志输出。查看控制台日志或日志文件,获取更多信息。
测试 Gradio Web UI 一旦模型和 controller 正常运行,可以启动 Gradio Web UI,确认是否能正确连接:
bash 复制代码 python3 -m llava.serve.gradio_web_server --controller http://localhost:10000 然后,打开浏览器访问 http://localhost:7860(如果端口没有修改),并检查能否与模型正常交互。
总结 确认 controller 和 model_worker 正常启动。 检查端口是否被占用,必要时更改端口。 查看日志或控制台输出,找出具体的错误提示。 测试 Gradio Web UI 是否可以正常连接。 如果模型仍然无法加载,可能需要更多详细的日志来进一步诊断。
bash 复制代码 python3 -m llava.serve.test_message --model-name llava-med-v1.5-mistral-7b --controller http://localhost:10000 确认 controller 和 worker 是否正确响应。
bash 复制代码 python3 -m llava.serve.gradio_web_server --controller http://localhost:10000 然后,访问 http://localhost:7860 来测试是否可以通过 Gradio 界面进行交互。
下一步 检查 controller 日志,确认是否注册了 worker。 重新发送测试消息,确保 worker 正确响应。 启动 Gradio Web UI,进行 Web 界面测试。
w@w-Precision-7960-Tower:~$ python3 -m llava.serve.gradio_web_server --controller http://localhost:10000
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/w/桌面/LLaVA-Med/LLaVA-Med/llava/serve/gradio_web_server.py", line 16, in
w@w-Precision-7960-Tower:~/桌面/LLaVA-Med/LLaVA-Med$ python3 -m llava.serve.gradio_web_server --controller http://localhost:10000
2024-09-16 20:08:54 | INFO | gradio_web_server | args: Namespace(host='0.0.0.0', port=None, controller_url='http://localhost:10000', concurrency_count=8, model_list_mode='once', share=False, moderate=False, embed=False)
2024-09-16 20:08:54 | INFO | gradio_web_server | Models: ['llavamed']
2024-09-16 20:08:54 | INFO | gradio_web_server | Namespace(host='0.0.0.0', port=None, controller_url='http://localhost:10000', concurrency_count=8, model_list_mode='once', share=False, moderate=False, embed=False)
2024-09-16 20:08:55 | INFO | stdout | Running on local URL: http://0.0.0.0:7860
2024-09-16 20:08:55 | INFO | stdout |
2024-09-16 20:08:56 | INFO | stdout | To create a public link, set share=True
in launch()
.
w@w-Precision-7960-Tower:~/桌面/LLaVA-Med/LLaVA-Med$ python3 -m llava.serve.gradio_web_server --controller http://localhost:10000
2024-09-16 20:08:54 | INFO | gradio_web_server | args: Namespace(host='0.0.0.0', port=None, controller_url='http://localhost:10000', concurrency_count=8, model_list_mode='once', share=False, moderate=False, embed=False)
2024-09-16 20:08:54 | INFO | gradio_web_server | Models: ['llavamed']
2024-09-16 20:08:54 | INFO | gradio_web_server | Namespace(host='0.0.0.0', port=None, controller_url='http://localhost:10000', concurrency_count=8, model_list_mode='once', share=False, moderate=False, embed=False)
2024-09-16 20:08:55 | INFO | stdout | Running on local URL: http://0.0.0.0:7860
2024-09-16 20:08:55 | INFO | stdout |
2024-09-16 20:08:56 | INFO | stdout | To create a public link, set share=True
in launch()
.
2024-09-16 20:09:26 | ERROR | asyncio | Task exception was never retrieved
future: <Task finished name='xdr4z7kefih_11' coro=<Queue.process_events() done, defined at /home/w/.local/lib/python3.10/site-packages/gradio/queueing.py:343> exception=1 validation error for PredictBody
event_id
Field required [type=missing, input_value={'fn_index': 11, 'data': ...on_hash': 'xdr4z7kefih'}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.9/v/missing>
Traceback (most recent call last):
File "/home/w/.local/lib/python3.10/site-packages/gradio/queueing.py", line 347, in process_events
client_awake = await self.gather_event_data(event)
File "/home/w/.local/lib/python3.10/site-packages/gradio/queueing.py", line 220, in gather_event_data
data, client_awake = await self.get_message(event, timeout=receive_timeout)
File "/home/w/.local/lib/python3.10/site-packages/gradio/queueing.py", line 456, in get_message
return PredictBody(**data), True
File "/home/w/.local/lib/python3.10/site-packages/pydantic/main.py", line 209, in init
validated_self = self.__pydantic_validator__.validate_python(data, self_instance=self)
pydantic_core._pydantic_core.ValidationError: 1 validation error for PredictBody
event_id
Field required [type=missing, input_value={'fn_index': 11, 'data': ...on_hash': 'xdr4z7kefih'}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.9/v/missing
gradio 3.34.0 pydantic 1.10.11 pydantic_core 2.1.2 pydub 0.25.1
bash 复制代码 pip uninstall gradio pydantic pydantic_core pydub
bash 复制代码 pip install gradio==3.34.0 pydantic==1.10.11 pydantic_core==2.1.2 pydub==0.25.1
bash 复制代码 pip show gradio pydantic pydantic_core pydub 这将显示每个包的详细信息,包括安装的版本号。
2024-09-16 20:22:03 | ERROR | stderr | ERROR: Exception in ASGI application 2024-09-16 20:22:03 | ERROR | stderr | Traceback (most recent call last): 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 406, in run_asgi 2024-09-16 20:22:03 | ERROR | stderr | result = await app( # type: ignore[func-returns-value] 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call 2024-09-16 20:22:03 | ERROR | stderr | return await self.app(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in call 2024-09-16 20:22:03 | ERROR | stderr | await super().call(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2024-09-16 20:22:03 | ERROR | stderr | await self.middleware_stack(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in call 2024-09-16 20:22:03 | ERROR | stderr | raise exc 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in call 2024-09-16 20:22:03 | ERROR | stderr | await self.app(scope, receive, _send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 85, in call 2024-09-16 20:22:03 | ERROR | stderr | await self.app(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in call 2024-09-16 20:22:03 | ERROR | stderr | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app 2024-09-16 20:22:03 | ERROR | stderr | raise exc 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app 2024-09-16 20:22:03 | ERROR | stderr | await app(scope, receive, sender) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 715, in call 2024-09-16 20:22:03 | ERROR | stderr | await self.middleware_stack(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 735, in app 2024-09-16 20:22:03 | ERROR | stderr | await route.handle(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle 2024-09-16 20:22:03 | ERROR | stderr | await self.app(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 76, in app 2024-09-16 20:22:03 | ERROR | stderr | await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app 2024-09-16 20:22:03 | ERROR | stderr | raise exc 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app 2024-09-16 20:22:03 | ERROR | stderr | await app(scope, receive, sender) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 73, in app 2024-09-16 20:22:03 | ERROR | stderr | response = await f(request) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/fastapi/routing.py", line 301, in app 2024-09-16 20:22:03 | ERROR | stderr | raw_response = await run_endpoint_function( 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/fastapi/routing.py", line 214, in run_endpoint_function 2024-09-16 20:22:03 | ERROR | stderr | return await run_in_threadpool(dependant.call, *values) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/concurrency.py", line 39, in run_in_threadpool 2024-09-16 20:22:03 | ERROR | stderr | return await anyio.to_thread.run_sync(func, args) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync 2024-09-16 20:22:03 | ERROR | stderr | return await get_async_backend().run_sync_in_worker_thread( 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread 2024-09-16 20:22:03 | ERROR | stderr | return await future 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run 2024-09-16 20:22:03 | ERROR | stderr | result = context.run(func, *args) 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/gradio/routes.py", line 289, in api_info 2024-09-16 20:22:03 | ERROR | stderr | return gradio.blocks.get_api_info(config, serialize) # type: ignore 2024-09-16 20:22:03 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/gradio/blocks.py", line 517, in get_api_info 2024-09-16 20:22:03 | ERROR | stderr | serializer = serializing.COMPONENT_MAPPING[type]() 2024-09-16 20:22:03 | ERROR | stderr | KeyError: 'dataset'
清理缓存
有时候,旧的缓存文件或配置可能会导致问题。尝试删除 Python 包的缓存,重新安装所需的版本。
bash 复制代码 pip cache purge pip install --force-reinstall gradio==3.34.0 pydantic==1.10.11 pydantic_core==2.1.2 pydub==0.25.1 更新 Gradio 配置
确保你使用的 Gradio 版本配置正确,并且没有使用不再受支持的功能或组件。查看 Gradio 的 官方文档 和 版本发布日志 来确认兼容性。
查看 Gradio 的 GitHub 问题页面
在 Gradio 的 GitHub 问题页面 查找类似的问题,有可能其他用户遇到过类似的问题,并且已经找到了解决方案。
降级到稳定版本
如果你仍然遇到问题,考虑降级到一个稳定版本的 Gradio 和其他相关库,并且确保所有版本都是互相兼容的。例如:
bash 复制代码 pip install gradio==3.33.0 # 或其他稳定版本 总结 确认版本兼容性:确保所有库版本之间兼容。 清理缓存并重新安装:删除旧的缓存文件并强制重新安装库。 检查配置:确保 Gradio 配置正确,并且没有使用不支持的功能。 查看 GitHub 问题页面:寻找类似问题的解决方案。 尝试稳定版本:如果问题仍然存在,尝试使用稳定的版本
w@w-Precision-7960-Tower:~/桌面/LLaVA-Med/LLaVA-Med$ python3 -m llava.serve.gradio_web_server --controller http://localhost:10000 /home/w/.local/lib/python3.10/site-packages/gradio_client/documentation.py:106: UserWarning: Could not get documentation group for <class 'gradio.mix.Parallel'>: No known documentation group for module 'gradio.mix' warnings.warn(f"Could not get documentation group for {cls}: {exc}") /home/w/.local/lib/python3.10/site-packages/gradio_client/documentation.py:106: UserWarning: Could not get documentation group for <class 'gradio.mix.Series'>: No known documentation group for module 'gradio.mix' warnings.warn(f"Could not get documentation group for {cls}: {exc}") 2024-09-16 20:25:40 | INFO | gradio_web_server | args: Namespace(host='0.0.0.0', port=None, controller_url='http://localhost:10000', concurrency_count=8, model_list_mode='once', share=False, moderate=False, embed=False) 2024-09-16 20:25:40 | INFO | gradio_web_server | Models: ['llavamed'] 2024-09-16 20:25:40 | INFO | gradio_web_server | Namespace(host='0.0.0.0', port=None, controller_url='http://localhost:10000', concurrency_count=8, model_list_mode='once', share=False, moderate=False, embed=False)
2024-09-16 20:25:58 | ERROR | stderr | ERROR: Exception in ASGI application 2024-09-16 20:25:58 | ERROR | stderr | Traceback (most recent call last): 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 406, in run_asgi 2024-09-16 20:25:58 | ERROR | stderr | result = await app( # type: ignore[func-returns-value] 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call 2024-09-16 20:25:58 | ERROR | stderr | return await self.app(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in call 2024-09-16 20:25:58 | ERROR | stderr | await super().call(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/applications.py", line 113, in call 2024-09-16 20:25:58 | ERROR | stderr | await self.middleware_stack(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in call 2024-09-16 20:25:58 | ERROR | stderr | raise exc 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in call 2024-09-16 20:25:58 | ERROR | stderr | await self.app(scope, receive, _send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 85, in call 2024-09-16 20:25:58 | ERROR | stderr | await self.app(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in call 2024-09-16 20:25:58 | ERROR | stderr | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app 2024-09-16 20:25:58 | ERROR | stderr | raise exc 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app 2024-09-16 20:25:58 | ERROR | stderr | await app(scope, receive, sender) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 715, in call 2024-09-16 20:25:58 | ERROR | stderr | await self.middleware_stack(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 735, in app 2024-09-16 20:25:58 | ERROR | stderr | await route.handle(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle 2024-09-16 20:25:58 | ERROR | stderr | await self.app(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 76, in app 2024-09-16 20:25:58 | ERROR | stderr | await wrap_app_handling_exceptions(app, request)(scope, receive, send) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app 2024-09-16 20:25:58 | ERROR | stderr | raise exc 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app 2024-09-16 20:25:58 | ERROR | stderr | await app(scope, receive, sender) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/routing.py", line 73, in app 2024-09-16 20:25:58 | ERROR | stderr | response = await f(request) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/fastapi/routing.py", line 301, in app 2024-09-16 20:25:58 | ERROR | stderr | raw_response = await run_endpoint_function( 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/fastapi/routing.py", line 214, in run_endpoint_function 2024-09-16 20:25:58 | ERROR | stderr | return await run_in_threadpool(dependant.call, *values) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/starlette/concurrency.py", line 39, in run_in_threadpool 2024-09-16 20:25:58 | ERROR | stderr | return await anyio.to_thread.run_sync(func, args) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync 2024-09-16 20:25:58 | ERROR | stderr | return await get_async_backend().run_sync_in_worker_thread( 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread 2024-09-16 20:25:58 | ERROR | stderr | return await future 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run 2024-09-16 20:25:58 | ERROR | stderr | result = context.run(func, *args) 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/gradio/routes.py", line 289, in api_info 2024-09-16 20:25:58 | ERROR | stderr | return gradio.blocks.get_api_info(config, serialize) # type: ignore 2024-09-16 20:25:58 | ERROR | stderr | File "/home/w/.local/lib/python3.10/site-packages/gradio/blocks.py", line 517, in get_api_info 2024-09-16 20:25:58 | ERROR | stderr | serializer = serializing.COMPONENT_MAPPING[type]() 2024-09-16 20:25:58 | ERROR | stderr | KeyError: 'dataset'
UserWarning: Failed to initialize NumPy: _ARRAY_API not found (Triggered internally at ../torch/csrc/utils/tensor_numpy.cpp:84.) device: torch.device = torch.device("cpu"), Models: ['llavamed']