-
### Feature request / 功能建议
ollama怎么部署新版v2
-
web_demo.py 运行需要10G显存。为啥 vllm 启动api模式运行，需要23G显存啊？
python web_demo.py --device cuda --dtype bf16
Vllm运行命令如下
/services/srv/MiniCPM-vllm/venv/bin/python -m vllm.entrypoints.openai.api_server --mo…
-
Does MiniCPM-V support multiple image? Asking because there are image comparison tasks in OpenCampus benchmark. How are those cases handled?
-
### 起始日期 | Start Date
_No response_
### 实现PR | Implementation PR
_No response_
### 相关Issues | Reference Issues
_No response_
### 摘要 | Summary
以KIE任务为例，是否有专门的提示词？
### 基本示例 | Basic Example
noth…
-
你好！MiniCPM-v2已被证实在提取高分辨率图片中的文本信息时拥有令人惊叹的准确度，并且远强于ominillm-12b，是非常优秀的模型。然而，可能是llm参数量太小的原因，MiniCPM-v2遵循人类指令和生成较长文本的能力比较弱。非常期待更大参数规模版本的MiniCPM-v2。
-
### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答？ | Is there an existing ans…
-
执行web_demo_2.5.py的时候，一定会默认下载模型，但是我已经手动下载了。
-
### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答？ | Is there an existing…
-
Subscribe to this issue and stay notified about new [daily trending repos in Jupyter Notebook](https://github.com/trending/jupyter-notebook?since=daily).
-
### System Info
accelerate 0.28.0
peft 0.10.0
torch == 2.2.1
transformer==4.39.2
flash-attn==2.5.6
python == 3.10
### Who can help?
@BenjaminBossan
### In…