search

zurawiki / tiktoken-rs

Ready-made tokenizer library for working with GPT and tiktoken
MIT License
240 stars 47 forks source link

Remove unnecessary type annotation leading to build errors #65

Open xmakro opened 3 months ago

xmakro commented 3 months ago

I also incremented the version to allow a new release