-
### Describe the issue
Getting this error when I run my python app:
python .\roberta.py
2024-04-04 21:24:37.4152414 [E:onnxruntime:, qnn_execution_provider.cc:499 onnxruntime::QNNExecutionProvider:…
-
When running plaidml-setup I get
```
Traceback (most recent call last):
File "/usr/local/bin/plaidml-setup", line 10, in
sys.exit(main())
File "/usr/local/lib/python3.5/dist-packages/pla…
-
### System Info
```Shell
`Accelerate` version: 0.31.0
- Platform: Linux-5.4.0-171-generic-x86_64-with-glibc2.35
- `accelerate` bash location: /workspace/Thesis/venv/bin/accelerate
- Python vers…
-
![image](https://github.com/TimDettmers/bitsandbytes/assets/5212919/009b60c5-6d62-4a19-81c9-c32417297cd5)
Trying to run the following code
```
### config ###
model_id = "NousResearch/Llama-2-7…
-
微调参考的是 https://qwen.readthedocs.io/zh-cn/latest/training/SFT/example.html
使用jsonl格式。
```
Qwen1.5/examples/sft/finetune.sh --use_lora True --deepspeed ds_config_zero2.json
```
量化参考的是https://qwen…
-
### System Info
Use google colab but connected localy with my computer using jupyter. I have Windows 10, RTX 3070 and no cuda or cudnn because I didn't succed to make it works :(
### Who can help?…
-
## 🐛 Bug
I have a bug with a fine-tuned (DORA) Qwen2-0.5B deployed with webllm. Inference always fail with the same error.
Error trace:
background.js:53 thread '' panicked at /home/cfruan/.car…
-
## Checklist:
1. 查找[历史相关issue](https://github.com/PaddlePaddle/PaddleX/issues)寻求解答
2. 翻阅[FAQ常见问题汇总和答疑](https://github.com/PaddlePaddle/PaddleX/blob/develop/docs/FAQ/FAQ.md)
3. 确认bug是否在新版本里还未修复
4…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
I downloaded the new one and it would output garbage over and over. Figured it was the quant so I loaded the previous versions. All output repeating nonsense. Tried both textgen and tabbyAPI. Other mo…