Compress ranks for size constrained environments

dqbd / tiktoken

JS port and JS/WASM bindings for openai/tiktoken

MIT License

649 stars 49 forks source link

Closed dqbd closed 1 year ago

dqbd commented 1 year ago

This PR is especially useful for Cloudflare Workers, where there is a 1 MB limit for free tier