-
Good Job! Do you have a plan to support LoRA or other PEFT?
-
🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.
==((====))== Unsloth: Fast Llama patching release 2024.6
\\ /| GPU: NVIDIA A100 80GB PCIe MIG 7g.80gb. Max memory: 7…
-
Thanks for your impressive work. But the dataset given in the Baidu disk doesn't fit the finetuning process. If I want to reprodce the results in your paper, should I download the official SUN RGB-D d…
-
# Title of the Talk: No Code SLM Finetuning with MonsterAPI
## Abstract of the Talk:
Dive into the world of no-code large language model (LLM) finetuning in this informative talk presented by Mons…
-
That sounds massively interesting, and while we try to run inference and read the paper, should we expect the release of the finetuning code?
-
lightning-cli getinfo
```
{
"id": "035aef5661e1a6e370db60dc0455796800afd5b51fbc12a0a8b34836b15f5d7ef6",
"alias": "TWronald✅",
"color": "15c315",
"num_peers": 9,
"num_pending_chann…
-
While executing the file in folder `Olive/examples/llama2` i got the error of
TypeError: LlamaForCausalLM.forward() got an unexpected keyword argument 'past_key_values.0.key'
while executing :
`py…
-
在finetune代码中,部分也加入了loss的计算,想请教下这样相比conditioning language modeling loss有什么特别的好处吗?
-
My current guess is that any fastchat-based code would work: create the model, apply all the patching you need, and then train?
The only question I have is about the dataset: does it have to contain…
-
Hi,
I created my own custom dataset by using the rlds dataset builder repo, and I'm trying to finetune on this data using `python scripts/finetune.py --config.pretrained_path=hf://rail-berkeley/oct…