SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.
214
stars
14
forks
source link
text-embedding-3-small", "cl100k_base #29
Closed
dmitry-brazhenko closed 9 months ago