search

zurawiki / tiktoken-rs

Ready-made tokenizer library for working with GPT and tiktoken
MIT License
254 stars 47 forks source link

minor change #28

Closed kojix2 closed 1 year ago

kojix2 commented 1 year ago

Hi

This is a completely unimportant pull request. Make test_num_tokens_from_messages look the same as test_get_chat_completion_max_tokens.

I am working on a Crystal binding for this library; this is my second day studying Rust and this is my first Rust pull request.

Feel free to close this one as it does not contain any essential changes. Thanks.

https://github.com/zurawiki/tiktoken-rs/blob/9decafb2d86c8af014370fd0f900d533e08fa209/tiktoken-rs/src/api.rs#L440-L447

zurawiki commented 1 year ago

Thanks for the PR. Happy to make the test code more consistent