-
How to finetuning the model (with LoRa)? The pytorch_lightning pipeline is hard to understand and modify. Can you give some API or pipeline?
-
Hi,
Did you try using multi-GPU for training?
I am hoping to finetune your model with 1/10 of the learning rate.
Wondering what is the change needed if using 8 GPU.
-
Hey,
Great to see LISA implemented here.
As for the background, I am trying to finetune models with LORA other techniques on domain data but the Task i am doing is Causal LM is Next word Predict…
-
Hi – thank you for open-sourcing this research project! Do you have plans to release code for fine-tuning these models?
-
Hi! I am wondering if it is possible to do the pretraining/finetuning for unimol with other extra features (like atom attributes)? And how to do it?
I would appreciate it a lot if you can help answer…
-
Hello!
I am a beginner and I've wanted to play with your finetuning script so I decided to run it on Google Colab. Just to test it out, I prepared train, test and eval datasets which contained only…
-
### Question
I have successfully done the pretrain stage, while for fintuning, i encounter following issues.
```
(llava2) wangyh@A16:/data/wangyh/mllms/LLaVA$ bash finetune2.sh
[2023-08-12 15:3…
-
**Research question**
Does BERT finetuning increase performance?
**Hypothesis**
Yes, the classifier in BERT will also pull apart the word embeddings belonging to specific locations, making it eas…
-
Hi,
Can you upload the retrieval fine-tuning model? Thank you!
-
### Feature description
For finetuning existing text generation model, LORA and QLORA are popularly being used. Can we create pipelines for download models from Huggingface, then finetune the m…