Closed PlanetMacro closed 6 months ago
Afaik it has its own tokenizer...
Currently, the text and image modals of gpt-4o are supported, and the video will be added later. Openai’s API does not involve tokenizer, did I miss something?
Afaik it has its own tokenizer...