-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
在A5000的显卡上,对100条数据进行重排序,需要5s才能完成
-
### Motivation
a relatively lightweight, but the effect is very good multimodal model
https://github.com/OpenBMB/MiniCPM-V
### Related resources
_No response_
### Additional context
_No response…
-
Our team released a fantastic end-side model called MiniCPM-2B recently.
Experimental Result:MiniCPM-2B outperforms Llama2-70B-Chat, Mistral-7B, etc. on MTBench.Runs ultra-fast on Apple Silicon.
…
-
Please let us know what model architectures you would like to be added!
**Up to date todo list below. Please feel free to contribute any model, a PR without device mapping, ISQ, etc. will still be …
-
感觉是用了fp16的原因. 你可以试试bf16或者fp32不
_Originally posted by @Jintao-Huang in https://github.com/modelscope/ms-swift/issues/1613#issuecomment-2301746025_
大佬我用的参数是auto,V100不支持bf16,应该是默认使用fp…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [x] 2. The bug has not been fixed in the latest version.
### Describe the bug
I try loading and make infere…
-
As the title, and beyond the title, is there any way to implementation rwkv llava, minicpm-v, internml-composer-v or qwen-v ?
-
When I tested Qwen2-7B on this library, it reported some errors.
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
from intel_npu_acceleration_library import NPUModelForCausalL…
-
this model has a vision adapter: mmproj-model-f16.gguf
i never used any vision model in lmstudio, so I don´t know if that is a bug or related to this particular model.
because this model has strong …