openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.06k stars 749 forks source link

Unable to route GET requests through proxy #259

Open aevilevitch opened 4 months ago

aevilevitch commented 4 months ago

I need to be able to call tiktoken in an environment where outbound traffic needs to be routed through a specific proxy. This is not possible with the current implementation of Tiktoken. One solution would be if read_file function in load.py would accept a session arg so the end user can pass a session with proxy.

Twilightaaa commented 4 months ago

same error, need some help!