-
### System Info / 系統信息
模型：glm4-9B-chat
配置文件：
data_config:
train_file: train.jsonl
val_file: dev.jsonl
test_file: dev.jsonl
num_proc: 1
max_input_length: 3500
max_output_length: 250…
-
Hi,
Thank you for the cool work! I realized that Visual PEFT Library is released according to the News section.
Could you please provide the GitHub link to the Visual PEFT Library? It would be s…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports.
### Exp…
-
##错误1
https://mindnlp.cqu.ai/tutorials/quick_start/#load-the-model
改正：from mindnlp.core.optim imp…
-
Hi, currently peft is supported in train.py with lora_enable flag, however during inference when loading model.builder, there seems to be a mismatch if the model was trained with lora or qlora. Wonder…
-
Hello again!
Would it be possible to modify the GMP fine tune script to train a LoRA with PEFT for the CLIP VIT-G model? Then merge the LoRA with the model to get a new CLIP-G model?
Chat-GPT se…
-
Given the model size being 1.1B parameters, I believe PEFT integration into the library would be beneficial, or at least having an example with our datasets and evaluators.
-
**Your hardware and system info**
Write your system info like CUDA version/system/GPU/torch version here(在这里给出硬件信息和系统信息，如CUDA版本，系统，GPU型号和torch版本等)
system: ubuntu 22.04
python: 3.11
GPU: 4060ti 16G…
-
Any chance of getting multi-adapter branch of PEFT integrated?
https://github.com/huggingface/peft/tree/smangrul/multi-lora-support
-
I slightly modified the code that I copied from the forecaster page. and I run into an error. Any suggestions? Thanks in advance.
Code is
~~~
"""
from datasets import load_dataset
from transform…