-
**Describe the bug**
i using the smoothquant and gptq to quantify Qwen2-0.5B-Instruct, but the model size has increased, which from 0.94G to 1.85G
**Expected behavior**
A clear and concise descri…
-
**Describe the bug**
Hi, I used the llm-compressor quantization script in a Colab notebook, but it gives me an error concerning the torch dtype.
**Expected behavior**
The quantized model should b…
-
### Environment
🪟 Windows
### System
w11
### Version
latest
### Desktop Information
_No response_
### Describe the problem
when i select whisper Local on the web ui speech r…
-
Running the code from the Model Card, I get this error:
`ValueError: 'dac' is already used by a Transformers config, pick another name.`
``` File "C:\Users\XXXX\AppData\Roaming\Python\Python311\…
-
**Describe the bug**
### 使用以下命令部署微调后的模型
CUDA_VISIBLE_DEVICES=1 swift deploy --model_type qwen2-vl-7b-instruct --model_id_or_path /root/ms-swift/train/qwen2-vl-7b-instruct/v1-20240906-145640/checkp…
-
Hello, it's a great work for me! I try to download model on huggingface.
# Load model directly
from transformers import AutoTokenizer
address = "./src/model/llaga-simteg-HO-classification"
confi…
-
Hello,
First of all, I would like to express my gratitude for the wonderful great research and resources provided by your team. They have been very helpful.
I am currently attempting to use this…
-
(.venv) (base) root@d7f34e41228d:~/Phi3-Vision-Finetune# python -m src.serve.app --model-path "/home/Phi3-Vision-Finetune/output/model"
The repository for /home/Phi3-Vision-Finetune/output/model cont…
-
# ComfyUI Error Report
## Error Details
- **Node Type:** Miaoshouai_Tagger
- **Exception Type:** RuntimeError
- **Exception Message:** Failed to import transformers.models.cohere.configuration_c…
-
How do we access "gated" huggingface repos with [pgml](https://pypi.org/project/pgml/)? I am using https://postgresml.org/docs/open-source/pgml/developers/quick-start-with-docker setup. I also tried…