-
Tested and it has very good quality for the size:
https://huggingface.co/openbmb/MiniCPM-V-2
-
### What is the issue?
FROM ./MiniCPM-V-2_5/model/ggml-model-Q4_K_M.gguf
FROM ./MiniCPM-V-2_5/mmproj-model-f16.gguf
TEMPLATE """{{ if .System }}system
{{ .System }}{{ end }}{{ if .Prompt }}use…
-
### What is the issue?
I created an Ollama model (for the fp16 GGUF) based on this: https://github.com/OpenBMB/ollama/tree/minicpm-v2.5/examples/minicpm-v2.5
When testing one of my sample forms …
-
As the title, and beyond the title, is there any way to implementation rwkv llava, minicpm-v, internml-composer-v or qwen-v ?
-
使用swift文档MLLM部署篇中的代码部署internVL2-8b后无法识别图片,代码如下:
from openai import OpenAI
client = OpenAI(
api_key='EMPTY',
base_url='http://localhost:10000/v1',
)
model_type = client.models.list().da…
-
大佬们,`MiniCPM-V-2`效果挺不错的,后续会有支持计划嘛
-
When I tested Qwen2-7B on this library, it reported some errors.
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
from intel_npu_acceleration_library import NPUModelForCausalL…
-
您好,对比了多家的vlm, minicpm-v做的还不错。
但是
1高精度图效果不行,你们为什么没采用5B的图像编码器呢?
2为什么没支持多图呢?
能从技术、效果解答我的疑问吗
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
请问跑minicpm-llama3-v-2_5(int4)支持并发调用接口么?2个及以上并发调用就报错了,单个没有问题。。。。
![微信截图_20240619180246](https://github.com/xorbitsai/inference/assets/167763677/caba7bf3-199d-4a24-88a3-b0e9833b50b2)
![微信截图_2024061918…