-
Hi I triied to convert vllm
```
python inference/convert_hf_to_vllmcpm.py --load ./cache/MiniCPM-V/ --save ./cache/MiniCPM-V-vllm
```
But got the following error:
FileNotFoundError: [Errno …
-
I installed conda install pytorch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 pytorch-cuda=12.1 -c
pytorch -c nvidia
but an error message showed up, RuntimeError: cutlassF: no kernel found to laun…
-
Hi, if I want to achieve the same effect as Online Demo, what resource configuration should I use?
uuhc updated
6 months ago
-
在线的demo一直请求失败，api调用也显示http无法连接，麻烦看下是不支持在线使用了吗？
-
dmxj updated
10 months ago
-
-
It would be nice if `ollama` could support LLaMA 3.2 Vision
https://huggingface.co/meta-llama/Llama-3.2-11B-Vision
![image](https://github.com/user-attachments/assets/322997ba-6cea-4a93-a2de-356…
-
RT
看到 swift 里面有 V1 的微调代码，请问在 V2.0 上可以直接使用么，还是需要重新开发一下？
-
-
**Describe the bug**
RuntimeError: output with shape [1, 210, 446] doesn't match the broadcast shape [3, 210, 446]
**Your hardware and system info**
CUDA11.8 pytorch2.2 A100-40g
**Addition…