-
### 问题确认 Search before asking
- [X] 我已经查询[历史issue](https://github.com/PaddlePaddle/PaddleSeg/issues)(包括open与closed)，没有发现相似的bug。I have searched the [open and closed issues](https://github.com/PaddlePa…
-
### Checklist
- [x] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue y…
-
when I using
`python -m qllm --model=/root/models/baichuan-inc/Baichuan2-7B-Base --method=gptq --nsamples=64 --wbits=4 --groupsize=128 --save /root/models/baichuan-inc/Baichuan2-7B-Base_gptq_4b --ex…
-
### System Info
Use google colab but connected localy with my computer using jupyter. I have Windows 10, RTX 3070 and no cuda or cudnn because I didn't succed to make it works :(
### Who can help?…
-
微调参考的是 https://qwen.readthedocs.io/zh-cn/latest/training/SFT/example.html
使用jsonl格式。
```
Qwen1.5/examples/sft/finetune.sh --use_lora True --deepspeed ds_config_zero2.json
```
量化参考的是https://qwen…
-
Hi, here is the INC team from Intel. Thank you for developing this amazing project.
### Motivation
Our team has developed a new weight-only quantization algorithm called Auto-Round. It has achie…
-
纯净debian系统，安装出现很多错误，最后也没打印用户名密码给我
root@4G-wifi:~# wget --no-check-certificate -qO crack_bt_panel_pro.sh https://raw.githubusercontent.com/leitbogioro/Crack_BT_Panel/master/crack_bt_panel_pro.sh &…
-
Tried to make an EXL2 of it.
I added the fix to the `inv_freq` scaling that is apparently expected in these models, making the following change in `model.py` (see https://huggingface.co/v2ray/Llama…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [x] 3. Please note that if the bug-related iss…
-
This is the code, I achived 4bits with normal libs
import gc
import os
import re
import torch
import tensorflow as tf
import pandas as pd
import matplotlib.pyplot as plt
import nltk
import …