search

pkoukk / tiktoken-go

go version of tiktoken
MIT License
601 stars 67 forks source link

create floder test for compare with openai tiktoken #4

Closed nasa1024 closed 1 year ago

nasa1024 commented 1 year ago

create floder test for compare with openai tiktoken Add more descriptions with reademe.md Add reademe_zh-hans.md

nasa1024 commented 1 year ago

@pkoukk 哥们你看下有哪些改错了的地方

pkoukk commented 1 year ago

wow..非常感谢你花时间测试这些模型数据