Update accelerate requirement from 0.28.0 to 0.30.0

[dependabot[bot]]

Updates the requirements on accelerate to permit the latest version.

Release notes

Sourced from accelerate's releases.

v0.30.0: Advanced optimizer support, MoE DeepSpeed support, add upcasting for FSDP, and more

Core

• We've simplified the tqdm wrapper to make it fully passthrough, no need to have tqdm(main_process_only, *args), it is now just tqdm(*args) and you can pass in is_main_process as a kwarg.
• We've added support for advanced optimizer usage:
  • Schedule free optimizer introduced by Meta by @​muellerzr in huggingface/accelerate#2631
  • LOMO optimizer introduced by OpenLMLab by @​younesbelkada in huggingface/accelerate#2695
• Enable BF16 autocast to everything during FP8 and enable FSDP by @​muellerzr in huggingface/accelerate#2655
• Support dataloader send_to_device calls to use non-blocking by @​drhead in huggingface/accelerate#2685
• allow gather_for_metrics to be more flexible by @​SunMarc in huggingface/accelerate#2710
• Add cann version info to command accelerate env for NPU by @​statelesshz in huggingface/accelerate#2689
• Add MLU rng state setter by @​ArthurinRUC in huggingface/accelerate#2664
• device agnostic testing for hooks&utils&big_modeling by @​statelesshz in huggingface/accelerate#2602

Documentation

• Through collaboration between @​fabianlim (lead contribuitor), @​stas00, @​pacman100, and @​muellerzr we have a new concept guide out for FSDP and DeepSpeed explicitly detailing how each interop and explaining fully and clearly how each of those work. This was a momumental effort by @​fabianlim to ensure that everything can be as accurate as possible to users. I highly recommend visiting this new documentation, available here
• New distributed inference examples have been added thanks to @​SunMarc in huggingface/accelerate#2672
• Fixed some docs for using internal trackers by @​brentyi in huggingface/accelerate#2650

DeepSpeed

• Accelerate can now handle MoE models when using deepspeed, thanks to @​pacman100 in huggingface/accelerate#2662
• Allow "auto" for gradient clipping in YAML by @​regisss in huggingface/accelerate#2649
• Introduce a deepspeed-specific Docker image by @​muellerzr in huggingface/accelerate#2707. To use, pull the gpu-deepspeed tag docker pull huggingface/accelerate:cuda-deepspeed-nightly

Megatron

• Megatron plugin can support NPU by @​zhangsheng377 in huggingface/accelerate#2667

Big Modeling

• Add strict arg to load_checkpoint_and_dispatch by @​SunMarc in huggingface/accelerate#2641

Bug Fixes

• Fix up state with xla + performance regression by @​muellerzr in huggingface/accelerate#2634
• Parenthesis on xpu_available by @​muellerzr in huggingface/accelerate#2639
• Fix is_train_batch_min type in DeepSpeedPlugin by @​yhna940 in huggingface/accelerate#2646
• Fix backend check by @​jiqing-feng in huggingface/accelerate#2652
• Fix the rng states of sampler's generator to be synchronized for correct sharding of dataset across GPUs by @​pacman100 in huggingface/accelerate#2694
• Block AMP for MPS device by @​SunMarc in huggingface/accelerate#2699
• Fixed issue when doing multi-gpu training with bnb when the first gpu is not used by @​SunMarc in huggingface/accelerate#2714
• Fixup free_memory to deal with garbage collection by @​muellerzr in huggingface/accelerate#2716
• Fix sampler serialization failing by @​SunMarc in huggingface/accelerate#2723
• Fix deepspeed offload device type in the arguments to be more accurate by @​yhna940 in huggingface/accelerate#2717

Full Changelog

• Schedule free optimizer support by @​muellerzr in huggingface/accelerate#2631
• Fix up state with xla + performance regression by @​muellerzr in huggingface/accelerate#2634
• Parenthesis on xpu_available by @​muellerzr in huggingface/accelerate#2639
• add third-party device prefix to execution_device by @​faaany in huggingface/accelerate#2612
• add strict arg to load_checkpoint_and_dispatch by @​SunMarc in huggingface/accelerate#2641
• device agnostic testing for hooks&utils&big_modeling by @​statelesshz in huggingface/accelerate#2602
• Docs fix for using internal trackers by @​brentyi in huggingface/accelerate#2650

... (truncated)

Commits

• 989cc50 Release: v0.30.0
• 060361f Fix tests on main (#2739)
• 6ac27e2 FEAT: Add LOMO optimizer (#2695)
• ba5f492 Fix offload device type (#2717)
• 2c76733 Fix Documentation in FSDP and DeepSpeed Concept Guide (#2725)
• 234a855 Docs: Fix build main documentation (#2729)
• 232ebd1 Fix sampler (#2728)
• 4d3d4bc fix sampler serialization (#2723)
• 2b1e7bd Fixup free_memory to deal with garbage collection (#2716)
• c7e5e41 Segment out a deepspeed docker image (#2707)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Superseded by #216.