I need to be able to call tiktoken in an environment where outbound traffic needs to be routed through a specific proxy. This is not possible with the current implementation of Tiktoken. One solution would be if read_file function in load.py would accept a session arg so the end user can pass a session with proxy.
I need to be able to call tiktoken in an environment where outbound traffic needs to be routed through a specific proxy. This is not possible with the current implementation of Tiktoken. One solution would be if read_file function in load.py would accept a session arg so the end user can pass a session with proxy.