-
Loading pipeline components...: 0%| | 0/7 [00:00
-
Could AutoGPTQ support the merge model from adapter and base model?
-
### System Info / 系統信息
python3.12,transformer 43;gpu 2080Ti22g*2
### Who can help? / 谁可以帮助到您？
_No response_
### Information / 问题信息
- [X] The official example scripts / 官方的示例脚本
- [ ] My own modifi…
-
I used the following code to sft llama3:
```
import os
import wandb
os.environ["WANDB_PROJECT"] = "unsloth-mimic-20240814" # name your W&B project
os.environ["WANDB_LOG_MODEL"] = "checkpoint" …
-
Hello, my situation is as follows:
I implemented qlora adapter to use with LLMs (currently bloom-560m). It works fine so far, after fine-tuning I get over 90% accuracy on my task. However, after sa…
-
### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答？ | Is there an existing ans…
-
Line https://github.com/lm-sys/FastChat/blob/main/fastchat/model/model_adapter.py#L325 receives model name instead of the complete or relative path when loading PEFT weight using PEFT adapter with gra…
-
配置：
系统：CentOS Linux release 7.9.2009
CUDA版本： 12.4
python版本： 3.11
NVIDIA-SMI ：550.54.14
我在使用hello_world推理时遇到了这个问题，已经提示重新编译了bitsandbytes，但还是出现了这个问题。
问题如下：
CUDA SETUP: Something unexpected happ…
-
**LocalAI version:**
OK:
- `local-ai-avx2-Linux-x86_64-1.40.0`
- `local-ai-avx2-Linux-x86_64-2.0.0`
- `local-ai-avx2-Linux-x86_64-2.8.0`
- `local-ai-avx2-Linux-x86_64-2.8.2`
- `local…
-
Hello, thank you very much for your contribution. An error was encountered during training
`Traceback (most recent call last):
File "/home/zhangc/PixelLM/train_ds.py", line 974, in
main(sys.…