Closed markusheimerl closed 7 months ago
"tiktoken is a fast BPE tokeniser for use with OpenAI's models." should be "tiktoken is a fast BPE tokenizer for use with OpenAI's models."
Existing spelling gets the point across, it's okay if Americans have to think for an extra millisecond :-)
"tiktoken is a fast BPE tokeniser for use with OpenAI's models." should be "tiktoken is a fast BPE tokenizer for use with OpenAI's models."