-
环境:win11,单卡 RTX 4070 (12G)
按照 Tutorial 操作
[Tutorial](https://github.com/InternLM/Tutorial/tree/main)/[xtuner](https://github.com/InternLM/Tutorial/tree/main/xtuner)
/README.md
2.3.6 将得到的 PTH 模型转换为…
-
Is it possible to fine-tune the model using a fine-tuning method such as LORA?
-
I was initially using a Wifi LoRa 32 V2 board for a project, before deciding to switch to the Cubecell GPS module instead, as GPS is more valuable to the project. I expected it to be a close-to-drop-i…
-
I'm getting messages over LoRa and sending to HTTPS server over WiFi.
All works except once in a few hours (quite randomly) board crashes. I tried with ESP32 v 1.0.2 and 1.0.3.
I suspect that issu…
-
Hello, I am training and fine-tuning SAMed on the Cityscapes dataset (related to this issue: #12 ) and I wish to completely remove the LoRA layers during the training process as I don't want to use L…
-
Is it possible to train a LoRA together with an Embedding? Here are some thoughts that came to this, when training a LoRA for an object:
1. Training the entire CLIP is wrong. It is best left frozen.
…
-
## Environment
- Platform: Debian Linux
- GPU: A100
- Torch: '2.1.2+cu121'
- Transfomers: '4.37.2'
## Issue
I'm seeing random and sudden loss spikes during training, if there is a simpler wa…
-
AssertionError: Bad Lora layer name: lora_te_text_model_encoder_layers_0_mlp_fc1.hada_w1_a - must end in lora_up.weight,
-- basically it's not loading the lora OR LYCORIS weights- Recognizing tha…
-
Im getting this errors and this wasn't happening until yesterday I have a workflow that use multi lora and model merge it work really well until something update and boom this error.
This is while th…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports.
…