viking-sudo-rm / rusty-dawg

Rust library for indexing and quickly searching large pretraining corpora
https://arxiv.org/abs/2406.13069
MIT License
17 stars 2 forks source link

Bump tokenizers from 0.20.0 to 0.20.1 #163

Closed dependabot[bot] closed 2 days ago

dependabot[bot] commented 3 weeks ago

Bumps tokenizers from 0.20.0 to 0.20.1.

Release notes

Sourced from tokenizers's releases.

Release v0.20.1

What's Changed

The most awaited offset issue with Llama is fixed 🥳

New Contributors

Full Changelog: https://github.com/huggingface/tokenizers/compare/v0.20.0...v0.20.1

Commits
  • d98298a 0.20.1
  • de305f2 update to ubuntu-22.04
  • 1053470 use --interpreter ${{ matrix.interpreter || '3.7 3.8 3.9 3.10 3.11 3.12 pypy3...
  • f7c33eb add Cargo
  • eca17be v 0.20.1-rc1
  • 557fde7 style: simplify string formatting for readability (#1632)
  • 3d51a16 Fix documentation build (#1642)
  • 294ab86 Bump webpack in /tokenizers/examples/unstable_wasm/www (#1641)
  • 2b97a5e Bump send and express in /tokenizers/examples/unstable_wasm/www (#1631)
  • 077678d Bump serve-static and express in /tokenizers/examples/unstable_wasm/www (#1630)
  • Additional commits viewable in compare view


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
dependabot[bot] commented 2 days ago

Superseded by #176.