search

pkoukk / tiktoken-go

go version of tiktoken
MIT License
601 stars 67 forks source link

add benchmark and benchmark document #22

Closed pkoukk closed 1 year ago