search

zurawiki / tiktoken-rs

Ready-made tokenizer library for working with GPT and tiktoken
MIT License
240 stars 47 forks source link

Add `gpt-3.5-turbo-0125` #60

Closed mikaelsouza closed 5 months ago

mikaelsouza commented 7 months ago

This PR adds gpt-3.5-turbo-0125 information to tiktoken-rs. I forgot to add this in my previous PR #59.