search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.98k stars 816 forks source link

Remove dependency on requests #271

Open tristan-jl opened 6 months ago

tristan-jl commented 6 months ago

This PR swaps requests for Python's built-in urllib.request library, reducing the library size a decent amount.

Would you consider a PR doing something like this? Happy to make alterations.