Bump tiktoken from 0.4.0 to 0.5.1

[dependabot[bot]]

Bumps tiktoken from 0.4.0 to 0.5.1.

Changelog

Sourced from tiktoken's changelog.

[v0.5.1]

• Add encoding_name_for_model, undo some renames to variables that are implementation details

[v0.5.0]

• Add tiktoken._educational submodule to better document how byte pair encoding works
• Ensure encoding_for_model knows about several new models
• Add decode_with_offets
• Better error for failures with the plugin mechanism
• Make more tests public
• Update versions of dependencies

Commits

• 39f29ce Sync codebase
• 52fceb8 Replace \<|endoftext|> with constant (#186)
• cc1848c Run only the most minimal test in emulated builds
• a793779 Sync codebase
• 5d970c1 Use future annotations in tiktoken._educational (#143)
• 95b03bf Fix up cibuildwheel
• c373d9b Sync codebase
• affbd6e Sync codebase
• See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)