search

pkoukk / tiktoken-go

go version of tiktoken
MIT License
601 stars 67 forks source link

enhancement: thread safe for get encoding #25

Closed pkoukk closed 1 year ago

pkoukk commented 1 year ago

Using sync.once make sure every go-routines read same instance of same encoding