Mostly fixing some stuff related to trust_remote_code=True and from_pretrained
The local_file_only was having a hard time when a .safetensors file did not exist. This is not expected and instead of trying to convert, we should just fallback to loading the .bin files.
Do not trigger autoconversion if local_files_only #31004 from @Wauplin fixes this!
Paligemma: Fix devices and dtype assignments (#31008) by @molbap
TLDR; Phi-3 introduces new ROPE scaling methods, which seems to scale fairly well! A 3b and a
Phi-3-mini is available in two context-length variants—4K and 128K tokens. It is the first model in its class to support a context window of up to 128K tokens, with little impact on quality.
JetMoe-8B is an 8B Mixture-of-Experts (MoE) language model developed by Yikang Shen and MyShell. JetMoe project aims to provide a LLaMA2-level performance and efficient language model with a limited budget. To achieve this goal, JetMoe uses a sparsely activated architecture inspired by the ModuleFormer. Each JetMoe block consists of two MoE layers: Mixture of Attention Heads and Mixture of MLP Experts. Given the input tokens, it activates a subset of its experts to process them. This sparse activation schema enables JetMoe to achieve much better training throughput than similar size dense models. The training throughput of JetMoe-8B is around 100B tokens per day on a cluster of 96 H100 GPUs with a straightforward 3-way pipeline parallelism strategy.
#12334: Support for Python 3.13 (beta1 at the time of writing).
Bug Fixes
#12120: Fix [PermissionError]{.title-ref} crashes arising from directories which are not selected on the command-line.
#12191: Keyboard interrupts and system exits are now properly handled during the test collection.
#12300: Fixed handling of 'Function not implemented' error under squashfuse_ll, which is a different way to say that the mountpoint is read-only.
#12308: Fix a regression in pytest 8.2.0 where the permissions of automatically-created .pytest_cache directories became rwx------ instead of the expected rwxr-xr-x.
Trivial/Internal Changes
#12333: pytest releases are now attested using the recent Artifact Attestation support from GitHub, allowing users to verify the provenance of pytest's sdist and wheel artifacts.
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore major version` will close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself)
- `@dependabot ignore minor version` will close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself)
- `@dependabot ignore ` will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself)
- `@dependabot unignore ` will remove all of the ignore conditions of the specified dependency
- `@dependabot unignore ` will remove the ignore condition of the specified dependency and ignore conditions
Bumps the python-packages group with 4 updates: tree-sitter, openai, transformers and pytest.
Updates
tree-sitterfrom 0.21.3 to 0.22.3Release notes
Sourced from tree-sitter's releases.
... (truncated)
Commits
2c0a6eechore: release 0.22.38042a8frefactor: remove unnecessary header filesd694939fix: more 32bit issues85e4948fix(language): use uintptr_ta82d764build: include header files in sdist79df26echore: release 0.22.10feea2efix(range): validate input9cc8445fix(node): use full count in field_name_for_child839d783refactor(node): don't expose internal function54f923afix(tree): return None if node is nullUpdates
openaifrom 1.25.0 to 1.30.5Release notes
Sourced from openai's releases.
... (truncated)
Changelog
Sourced from openai's changelog.
... (truncated)
Commits
e872382release: 1.30.5e565c94chore(internal): fix lint issue6e7d854Update Microsoft Azure OpenAI docs in README (#1439)bb0b38drelease: 1.30.4379c6a3chore: add missing all definitions59855b2chore(internal): fix lint issue7fff7c8release: 1.30.399f4939docs(contributing): update references to rye-up.com302f45achore(internal): fix lint issue (#1444)17c2876chore(internal): bump pyright (#1442)Updates
transformersfrom 4.40.1 to 4.41.2Release notes
Sourced from transformers's releases.
... (truncated)
Commits
ab0f050Release: v4.41.257f5553Fix faulty rstrip in module loading (#31108)73b180cfix from_pretrained in offline mode when model is preloaded in cache (#31010)a6325a7Redirect transformers_agents doc to agents (#31054)9ccdc84Paligemma- fix devices and dtype assignments (#31008)12aa316Do not trigger autoconversion if local_files_only (#31004)75f15f3Release: v4.41.18282db5Paligemma causal attention mask (#30967)e5b788aRevert "feat: Upgrade Weights & Biases callback (#30135)"9d05459Generation: get special tokens from model config (#30899)Updates
pytestfrom 8.2.0 to 8.2.1Release notes
Sourced from pytest's releases.
Commits
66ff8dfPrepare release version 8.2.13ffcfd1Merge pull request #12340 from pytest-dev/backport-12334-to-8.2.x0b28313[8.2.x] Add Python 3.13 (beta) supportf3dd93a[8.2.x] Attest package provenance (#12335)bb5a125[8.2.x] Spelling (#12331)f179bf2Merge pull request #12327 from pytest-dev/backport-12325-to-8.2.x2b671b5[8.2.x] cacheprovider: fix.pytest_cachenot being world-readable65ab7cbMerge pull request #12324 from pytest-dev/backport-12320-to-8.2.x4d5fb7dMerge pull request #12319 from pytest-dev/backport-12311-to-8.2.xcbe5996[8.2.x] changelog: document unittest 8.2 change as breakingDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show