Update tokenizers requirement from 0.15.0 to 0.19.1

[dependabot[bot]]

Updates the requirements on tokenizers to permit the latest version.

Release notes

Sourced from tokenizers's releases.

v0.15.2

What's Changed

Big shoutout to @​rlrs for the fast replace normalizers PR. This boosts the performances of the tokenizers:

• chore: Update dependencies to latest supported versions by @​bryantbiggs in huggingface/tokenizers#1441
• Convert word counts to u64 by @​stephenroller in huggingface/tokenizers#1433
• Efficient Replace normalizer by @​rlrs in huggingface/tokenizers#1413

New Contributors

• @​bryantbiggs made their first contribution in huggingface/tokenizers#1441
• @​stephenroller made their first contribution in huggingface/tokenizers#1433
• @​rlrs made their first contribution in huggingface/tokenizers#1413

Full Changelog: https://github.com/huggingface/tokenizers/compare/v0.15.1...v0.15.2rc1

Commits

• 701a73b correct version for the release
• f11fd7a add cargo lock version = "0.15.2-rc1"
• c893204 Efficient Replace normalizer (#1413)
• 4a8105c Convert word counts to u64 (#1433)
• 67fe59c chore: Update dependencies to latest supported versions (#1441)
• 8f73fe9 update dev version to 0.15.2-dev.0
• accd065 Update release for python3.12 windows (#1438)
• 6a77d48 Encode special tokens (#1437)
• 888dd4b pyo3: update to 0.20 (#1386)
• 8939d4e Bump follow-redirects in /tokenizers/examples/unstable_wasm/www (#1430)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)