xusenlinzy / api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口
Apache License 2.0
2.36k stars 270 forks source link

[Bug] vLLM 镜像中Pydantic版本冲突 #251

Closed liuyanyi closed 7 months ago

liuyanyi commented 8 months ago

提交前必须检查以下项目 | The following items must be checked before submission

问题类型 | Type of problem

安装环境 | Installation environment

操作系统 | Operating system

Linux

详细描述问题 | Detailed description of the problem

https://github.com/xusenlinzy/api-for-open-llm/blob/9d1ff578a43619a505d8ead9147557cd98bc8e46/docker/Dockerfile.vllm#L9-L10

当前的 Dockerfile.vllm 中的安装顺序是先安装vLLM再安装requirements,项目中的requirements固定了pydantic版本为1.10.13,与 vLLM 中 pydantic>2 冲突,启动时会报错,#250 也是相似的issue

项目代码似乎已经兼容了pydantic 1 和 2 , 是否可以考虑放宽依赖版本到 pydantic>=1.10.13

Dependencies

No response

运行日志或截图 | Runtime logs or screenshots

# 请在此处粘贴运行日志
# Please paste the run log here
xusenlinzy commented 8 months ago

可以的,升级一下pydantic应该就可以

syusama commented 8 months ago

我当时也遇到这个问题,搞了我一个周末