huggingface / peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
https://huggingface.co/docs/peft
Apache License 2.0
16.46k stars 1.62k forks source link

FIX Missing low_cpu_mem_usage argument #2156

Closed BenjaminBossan closed 1 month ago

BenjaminBossan commented 1 month ago

The newly introduced low_cpu_mem_usage argument was not propagated to the add_adapter method of all PeftModel task types. This is now fixed and tests were added.

Tests were only added for LoRA to avoid running many relatively slow and redundant tests and because low_cpu_mem_usage is not implemented for prompt learning models.

HuggingFaceDocBuilderDev commented 1 month ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.