zurawiki / tiktoken-rs

Ready-made tokenizer library for working with GPT and tiktoken
MIT License
254 stars 47 forks source link

Make the crate independent of async_openai #13

Closed thedenisnikulin closed 1 year ago

thedenisnikulin commented 1 year ago

The crate seem to use async_openai only for messages, but this a pretty small thing that should not require to bring in a whole crate to its dependencies. I just want to use this crate with other implementation of openai api wrapper, not async_openai, but it's the only things that comes in the way

zurawiki commented 1 year ago

Hi I'm heard that feedback from other issues as well #10 . Marking this issue as a duplicate so we can focus efforts on addressing this