knuddelsgmbh / jtokkit

JTokkit is a Java tokenizer library designed for use with OpenAI models.
https://jtokkit.knuddels.de/
MIT License
518 stars 38 forks source link

chore(deps): update dependency tiktoken to v0.3.3 #9

Closed renovate[bot] closed 1 year ago

renovate[bot] commented 1 year ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
tiktoken (changelog) ==0.3.2 -> ==0.3.3 age adoption passing confidence

Release Notes

openai/tiktoken ### [`v0.3.3`](https://togithub.com/openai/tiktoken/blob/HEAD/CHANGELOG.md#v033) [Compare Source](https://togithub.com/openai/tiktoken/compare/0.3.2...0.3.3) - `tiktoken` will now make a best effort attempt to replace surrogate pairs with the corresponding Unicode character and will replace lone surrogates with the Unicode replacement character.

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

â™» Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.



This PR has been generated by Mend Renovate. View repository job log here.