-
启动命令：CUDA_VISIBLE_DEVICES=0,1 swift infer --model_path /home/a/Qwen2-VL-7B-Instruct/ --model_type qwen2-vl-7b-instruct
请大佬指教谢谢：
报错 ：(llm_swift) a@a:~$ CUDA_VISIBLE_DEVICES=0,1 swift infer --model_…
wuybo updated
2 weeks ago
-
I'm not able to run inference for my fine tuned model - tried running the command in the documentation.
I finetuned my model using:
```
swift sft \
--model_type florence-2-large \
--s…
-
It seems that the following post-processor block in tokenizer.json is not supported:
````
"post_processor": {
"type": "Sequence",
"processors": [
{
"type": "ByteLevel",…
-
## 环境准备 （Environmental Preparation）
```bash
# 安装ms-swift （Install ms-swift）
pip install git+https://github.com/modelscope/swift.git#egg=ms-swift[llm]
# 安装最新的transformers（Install the latest trans…
-
## lora微调qwen2.5-7b逐渐爆显存
- 版本
torch 2.4.0
transformers 4.46.1
ms-swift 2.5.1.post1
- 报错
torch.OutOfMemoryError: CU…
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue y…
-
First of all, thank you for creating this awesome library for the community. I was just wondering if it would be possible to add an installation guide so that beginners like me could learn how to inst…
mzbac updated
7 months ago
-
报下面的错误
```bash
RuntimeError: weight should have at least three dimensions
Traceback (most recent call last):
File "/mnt/bn/arnold-ghh-test/mlx/users/guihonghao/playground/ghh_swift/swift/example…
-
### 报错描述
使用swift infer命令，do_sample=True时报错，do_sample=False时可以推理但生成结果乱码
### 环境
- NPU：昇腾910B3
- Python：3.9.18
- ms-swift：2.4.0.post1
- torch-npu：2.1.0
- Transformers：4.37.2
### 推理模型
Qwen2-7…
-
**Describe the bug**
What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程，最好有截图)
**Your hardware and system info**
Write your system info like CUDA version/system/GPU/torc…