pkoukk / tiktoken-go

go version of tiktoken

MIT License

649 stars 71 forks source link

feat: include o200k and gpt-4o #48

Closed jinyuanlu closed 4 months ago

jinyuanlu commented 4 months ago

What's the PR for

Include o200k and enable gpt-4o.