search

mvitlov / tiktoken

tiktoken is a BPE tokeniser for use with OpenAI's models
Other
23 stars 7 forks source link

fit build huge time in release mode #6

Open JerryFans opened 1 year ago

JerryFans commented 1 year ago

fit build huge time in release mode, issue: https://github.com/mvitlov/tiktoken/issues/5