Bump accelerate from 0.28.0 to 0.29.2

[dependabot[bot]]

Bumps accelerate from 0.28.0 to 0.29.2.

Release notes

Sourced from accelerate's releases.

v0.29.2: Patchfix

• Fixes xpu missing parenthesis huggingface/accelerate#2639
• Fixes XLA and performance degradation on init with the state huggingface/accelerate#2634

v0.29.1: Patchfix

Fixed an import which would cause running accelerate CLI to fail if pytest wasn't installed

v0.29.0: NUMA affinity control, MLU Support, and DeepSpeed Improvements

Core

• Accelerate can now optimize NUMA affinity, which can help increase throughput on NVIDIA multi-GPU systems. To enable it either follow the prompt during accelerate config, set the ACCELERATE_CPU_AFFINITY=1 env variable, or manually using the following:

from accelerate.utils import set_numa_affinity
For GPU 0
set_numa_affinity(0)

Big thanks to @​stas00 for the recommendation, request, and feedback during development

• Allow for setting deterministic algorithms in set_seed by @​muellerzr in huggingface/accelerate#2569
• Fixed the test script for TPU v2/v3 by @​vanbasten23 in huggingface/accelerate#2542
• Cambricon MLU device support introduced by @​huismiling in huggingface/accelerate#2552
• A big refactor was performed to the PartialState and AcceleratorState to allow for easier future-proofing and simplification of adding new devices by @​muellerzr in huggingface/accelerate#2576
• Fixed a reproducibility issue in distributed environments with Dataloader shuffling when using BatchSamplerShard by @​universuen in huggingface/accelerate#2584
• notebook_launcher can use multiple GPUs in Google Colab if using a custom instance that supports multiple GPUs by @​StefanTodoran in huggingface/accelerate#2561

Big Model Inference

• Add log message for RTX 4000 series when performing multi-gpu inference with device_map which can lead to hanging by @​SunMarc in huggingface/accelerate#2557
• Fix load_checkpoint_in_model behavior when unexpected keys are in the checkpoint by @​fxmarty in huggingface/accelerate#2588

DeepSpeed

• Fix issue with the mapping of main_process_ip and master_addr when not using standard as deepspeed launcher by @​asdfry in huggingface/accelerate#2495
• Improve deepspeed env gen by checking for bad keys, by @​muellerzr and @​ricklamers in huggingface/accelerate#2565
• We now support custom deepspeed env files. Like normal deepspeed, set it with the DS_ENV_FILE environmental variable by @​muellerzr in huggingface/accelerate#2566
• Resolve ZeRO-3 Initialization Failure in already-started distributed environments by @​sword865 in huggingface/accelerate#2578

What's Changed

• Fix test_script.py on TPU v2/v3 by @​vanbasten23 in huggingface/accelerate#2542
• Add mapping main_process_ip and master_addr when not using standard as deepspeed launcher by @​asdfry in huggingface/accelerate#2495
• split_between_processes for Dataset by @​geronimi73 in huggingface/accelerate#2433
• Include working driver check by @​muellerzr in huggingface/accelerate#2558
• 🚨🚨🚨Move to using tags rather than latest for docker images and consolidate image repos 🚨 🚨🚨 by @​muellerzr in huggingface/accelerate#2554
• Add Cambricon MLU accelerator support by @​huismiling in huggingface/accelerate#2552
• Add NUMA affinity control for NVIDIA GPUs by @​muellerzr in huggingface/accelerate#2535
• Add log message for RTX 4000 series when performing multi-gpu inference with device_map by @​SunMarc in huggingface/accelerate#2557
• Improve deepspeed env gen by @​muellerzr in huggingface/accelerate#2565
• Allow for setting deterministic algorithms by @​muellerzr in huggingface/accelerate#2569
• Unpin deepspeed by @​muellerzr in huggingface/accelerate#2570
• Rm uv install by @​muellerzr in huggingface/accelerate#2577
• Allow for custom deepspeed env files by @​muellerzr in huggingface/accelerate#2566
• [docs] Missing functions from API by @​stevhliu in huggingface/accelerate#2580

... (truncated)

Commits

• 39e0a8e Release: v0.29.2
• 759a933 Patch for v0.29.2
• 2107783 Release: v0.29.1
• 12eed81 Fixup
• ec88c8f Release: v0.29.0
• 7531e8c Unpin hub (#2625)
• 8e439de Link to bash in env reporting (#2623)
• d96a5aa Fix links in Quick Tour (#2617)
• d7bcd85 fix llama example for pippy (#2616)
• d927b8f Default false for trust_remote_code (#2607)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Superseded by #53.