search

zurawiki / tiktoken-rs

Ready-made tokenizer library for working with GPT and tiktoken
MIT License
240 stars 47 forks source link

Good points. How are you benchmarking these times today? #78

Closed darksonblade closed 1 month ago

darksonblade commented 1 month ago

nfmk