issues
search
foundation-model-stack
/
fms-hf-tuning
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
Apache License 2.0
28
stars
48
forks
source link
doc: How to tune LoRA lm_head
#305
Closed
aluu317
closed
3 months ago
aluu317
commented
3 months ago
Description of the change
We need to document on how to LoRA tune
lm_head
layer
Related issue number
How to verify the PR
Was the PR tested
[ ] I have added >=1 unit test(s) for every new method I have added.
[ ] I have ensured all unit tests pass
Description of the change
We need to document on how to LoRA tune
lm_headlayerRelated issue number
How to verify the PR
Was the PR tested