search

IAPark / tiktoken_ruby

Unofficial ruby binding for tiktoken by way of rust
MIT License
109 stars 26 forks source link

Add a warning that get_encoding is not thread safe #31

Closed IAPark closed 3 months ago

IAPark commented 3 months ago

This is following a suggestion from here https://github.com/IAPark/tiktoken_ruby/issues/8#issuecomment-2016434827