Bump peft from 0.6.0 to 0.7.1

[dependabot[bot]]

Bumps peft from 0.6.0 to 0.7.1.

Release notes

Sourced from peft's releases.

v0.7.1 patch release

This is a small patch release of PEFT that should handle:

• Issues with loading multiple adapters when using quantized models (#1243)
• Issues with transformers v4.36 and some prompt learning methods (#1252)

What's Changed

• [docs] OFT by @​stevhliu in huggingface/peft#1221
• Bump version to 0.7.1.dev0 post release by @​BenjaminBossan in huggingface/peft#1227
• Don't set config attribute on custom models by @​BenjaminBossan in huggingface/peft#1200
• TST: Run regression test in nightly test runner by @​BenjaminBossan in huggingface/peft#1233
• Lazy import of bitsandbytes by @​BenjaminBossan in huggingface/peft#1230
• FIX: Pin bitsandbytes to <0.41.3 temporarily by @​BenjaminBossan in huggingface/peft#1234
• [docs] PeftConfig and PeftModel by @​stevhliu in huggingface/peft#1211
• TST: Add tolerance for regression tests by @​BenjaminBossan in huggingface/peft#1241
• Bnb integration test tweaks by @​Titus-von-Koeller in huggingface/peft#1242
• [docs] PEFT integrations by @​stevhliu in huggingface/peft#1224
• Revert "FIX Pin bitsandbytes to <0.41.3 temporarily (#1234)" by @​Titus-von-Koeller in huggingface/peft#1250
• Fix model argument issue (#1198) by @​ngocbh in huggingface/peft#1205
• TST: Add tests for 4bit LoftQ by @​BenjaminBossan in huggingface/peft#1208
• [docs] Quantization by @​stevhliu in huggingface/peft#1236
• FIX: Truncate slack message to not exceed 3000 chars by @​BenjaminBossan in huggingface/peft#1251
• Issue with transformers 4.36 by @​BenjaminBossan in huggingface/peft#1252
• Fix: Multiple adapters with bnb layers by @​BenjaminBossan in huggingface/peft#1243
• Release: 0.7.1 by @​BenjaminBossan in huggingface/peft#1257

New Contributors

• @​Titus-von-Koeller made their first contribution in huggingface/peft#1242
• @​ngocbh made their first contribution in huggingface/peft#1205

Full Changelog: https://github.com/huggingface/peft/compare/v0.7.0...v0.7.1

v0.7.0: Orthogonal Fine-Tuning, Megatron support, better initialization, safetensors, and more

Highlights

• Orthogonal Fine-Tuning (OFT): A new adapter that is similar to LoRA and shows a lot of promise for Stable Diffusion, especially with regard to controllability and compositionality. Give it a try! By @​okotaku in huggingface/peft#1160
• Support for parallel linear LoRA layers using Megatron. This should lead to a speed up when using LoRA with Megatron. By @​zhangsheng377 in huggingface/peft#1092
• LoftQ provides a new method to initialize LoRA layers of quantized models. The big advantage is that the LoRA layer weights are chosen in a way to minimize the quantization error, as described here: https://arxiv.org/abs/2310.08659. By @​yxli2123 in huggingface/peft#1150.

Other notable additions

• It is now possible to choose which adapters are merged when calling merge (#1132)
• IA³ now supports adapter deletion, by @​alexrs (#1153)
• A new initialization method for LoRA has been added, "gaussian" (#1189)
• When training PEFT models with new tokens being added to the embedding layers, the embedding layer is now saved by default (#1147)
• It is now possible to mix certain adapters like LoRA and LoKr in the same model, see the docs (#1163)
• We started an initiative to improve the documenation, some of which should already be reflected in the current docs. Still, help by the community is always welcome. Check out this issue to get going.

Migration to v0.7.0

... (truncated)

Commits

• 67a0800 Release: 0.7.1 (#1257)
• 971dd6e Fix: Multiple adapters with bnb layers (#1243)
• ee6f6dc FIX Issues with transformers 4.36 (#1252)
• 21c304f FIX Truncate slack message to not exceed 3000 char (#1251)
• e73967e [docs] Quantization (#1236)
• b08e6fa TST: Add tests for 4bit LoftQ (#1208)
• 5c13ea3 FIX Use model argument consistently (#1198) (#1205)
• 00b8200 Revert "FIX Pin bitsandbytes to <0.41.3 temporarily (#1234)" (#1250)
• 504d3c8 [docs] PEFT integrations (#1224)
• fc9f4b3 Bnb integration test tweaks (#1242)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Superseded by #312.