[v0.23.2] Patch: Support max_shard_size as string in split_state_dict_into_shards_factory
split_state_dict_into_shards_factory now accepts string values as max_shard_size (ex: "5MB"), in addition to integer values. Related PR: huggingface/huggingface_hub#2286.
v0.23.0: LLMs with tools, seamless downloads, and much more!
📁 Seamless download to local dir
The 0.23.0 release comes with a big revamp of the download process, especially when it comes to downloading to a local directory. Previously the process was still involving the cache directory and symlinks which led to misconceptions and a suboptimal user experience. The new workflow involves a .cache/huggingface/ folder, similar to the .git/ one, that keeps track of the progress of a download. The main features are:
With this addition, interrupted downloads are now resumable! This applies both for downloads in local and cache directories which should greatly improve UX for users with slow/unreliable connections. In this regard, the resume_download parameter is now deprecated (not relevant anymore).
Revamp download to local dir process by @Wauplin in #2223
Rename .huggingface/ folder to .cache/huggingface/ by @Wauplin in #2262
💡 Grammar and Tools in InferenceClient
It is now possible to provide a list of tools when chatting with a model using the InferenceClient! This major improvement has been made possible thanks to TGI that handle them natively.
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Taniya-Das
commented
1 month ago
Bumps huggingface-hub from 0.20.3 to 0.23.4.
Release notes
Sourced from huggingface-hub's releases.
... (truncated)
Commits
4c7aa33Release: v0.23.4588f12cfix test after cherry54b4514Fix: correctly encode/decode config in ModelHubMixin if custom coders (#2337)9bce62fDon't override 'config' in model_kwargs (#2274)adf5672Support custom kwargs for model card in save_pretrained (#2310)23d3bb4🌐 [i18n-KO] Translatedguides/integrations.mdto Korean (#2256)6f91049Fix ModelHubMixin coders (#2291)30e5192ModelHubMixin: Fix attributes lost in inheritance (#2305)83efe51Release: v0.23.3ddfc007Fix always None in text_generation output (#2316)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show