knuddelsgmbh / jtokkit

JTokkit is a Java tokenizer library designed for use with OpenAI models.
https://jtokkit.knuddels.de/
MIT License
516 stars 38 forks source link

chore(deps): update dependency tiktoken to v0.6.0 #86

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
tiktoken (changelog) ==0.5.2 -> ==0.6.0 age adoption passing confidence

Release Notes

openai/tiktoken (tiktoken) ### [`v0.6.0`](https://togithub.com/openai/tiktoken/blob/HEAD/CHANGELOG.md#v060) [Compare Source](https://togithub.com/openai/tiktoken/compare/0.5.2...0.6.0) - Optimise regular expressions for a 20% performance improvement, thanks to [@​paplorinc](https://togithub.com/paplorinc)! - Add `text-embedding-3-*` models to `encoding_for_model` - Check content hash for downloaded files - Allow pickling `Encoding` objects. Registered `Encoding` will be pickled by reference - Workaround PyO3 bug for frozenset conversion Thank you to [@​paplorinc](https://togithub.com/paplorinc), [@​mdwelsh](https://togithub.com/mdwelsh), [@​Praneet460](https://togithub.com/Praneet460)!

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

â™» Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.



This PR has been generated by Mend Renovate. View repository job log here.