-
### Model Series
Qwen2.5
### What are the models used?
Qwen2.5-72B-Instruct-GPTQ-Int4
### What is the scenario where the problem happened?
Qwen2.5-72B-Instruct-GPTQ-Int4 params error
### Is this…
-
command:
```
cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1 \
--model=gptj-99 \
--implementation=reference \
--framework=pytorch \
--category=edge \
--sc…
-
**Describe the bug**
when run line:model.quantize(examples) got AttributeError: 'NoneType' object has no attribute 'parameters'
**GPU Info**
Show output of:
```
+-------------------…
-
Thanks for your error report and we appreciate it a lot.
**Checklist**
* I have searched the tutorial on modelscope [doc-site](https://modelscope.cn/docs)
* I have searched related issues but …
-
I'm encountering an error when trying to train using a recently uploaded model on Civitai (https://civitai.com/models/833294?modelVersionId=968495). The following error occurs:
```
Traceback (most…
-
I'm using BAAI/bge-m3 and BAAI/bge-visualized/Visualized_m3.pth.
I download model manually, I give the local path, It gives out error as below:
```bash
File "bge_visualized.py", line 3, in
…
-
As already described in https://github.com/firecow/gitlab-ci-local/issues/1026.
It seems that the rsync command which is executed by gcl is not 100% working under windows gitbash.
I can run "gcl…
-
### System Info
- 2x H100 80GB on docker container (nvidia/cuda:12.4.1-devel-ubuntu22.04)
- last version of the library
### Who can help?
_No response_
### Information
- [X] The official example…
-
(openvino) [root@localhost openvino]# python3 convert.py --model_id /root/Glm4/GLM-4/glm-4-9b-chat/ --precision int8 --output /root/Glm4/Intel/glm-4-9b-chat-ov
====Exporting IR=====
Traceback (most…
-
### 🐛 Describe the bug
Script
~~~
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
import os
os.environ["TOKENIZERS_PARALLELISM"] = "false" # To prevent long warnin…