Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k
stars
81
forks
source link
build(deps): update accelerate requirement from ~=0.20.3 to ~=0.24.0 #271
v0.24.0: Improved Reproducability, Bug fixes, and other Small Improvements
Improved Reproducibility
One critical issue with Accelerate is training runs were different when using an iterable dataset, no matter what seeds were set. v0.24.0 introduces the dataloader.set_epoch() function to all AccelerateDataLoaders, where if the underlying dataset (or sampler) has the ability to set the epoch for reproducability it will do so. This is similar to the implementation already existing in transformers. To use:
dataloader = accelerator.prepare(dataloader)
# Say we want to resume at epoch/iteration 2
dataloader.set_epoch(2)
For more information see this PR, we will update the docs on a subsequent release with more information on this API.
Documentation
The quick tour docs have gotten a complete makeover thanks to @MKhalusova. Take a look here
We also now have documentation on how to perform multinode training, see the launch docs
Internal structure
Shared file systems are now supported under save and save_state via the ProjectConfiguration dataclass. See #1953 for more info.
FSDP can now be used for bfloat16 mixed precision via torch.autocast
all_gather_into_tensor is now used as the main gather operation, reducing memory in the cases of big tensors
Specifying drop_last=True will now properly have the desired affect when performing Accelerator().gather_for_metrics()
Most Recent Ignore Conditions Applied to This Pull Request
| Dependency Name | Ignore Conditions |
| --- | --- |
| accelerate | [>= 0.22.0.a, < 0.22.1] |
| accelerate | [>= 0.23.a, < 0.24] |
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Updates the requirements on accelerate to permit the latest version.
Release notes
Sourced from accelerate's releases.
... (truncated)
Commits
00301b2
Release: v0.24.0eb8c535
Fix (#2080)b7686cc
Warn when kernel version is too low on Linux (#2077)f322987
fix docstring typo (#2072)7843286
Allow for samplers to be seedable and reproducable (#2057)11e2e99
Let iterable dataset shard have a len (#2066)07e745f
DOC: Fix broken link to designing a device map (#2073)c7c99a3
fix: remove useless token (#2069)8f45a2e
remove unused constants (#2045)9fd64b7
Fix the error when the "train_batch_size" is absent in DeepSpeed config (#2060)Most Recent Ignore Conditions Applied to This Pull Request
| Dependency Name | Ignore Conditions | | --- | --- | | accelerate | [>= 0.22.0.a, < 0.22.1] | | accelerate | [>= 0.23.a, < 0.24] |Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show