With the release of OpenAI o1-preview and o1-mini, the costs also include internal reasoning tokens. Therefore, pricing comparisons with classical one-shot models is not possible. I.e. o1-mini costs $15 and Sonnet 3.5 costs $18 but Sonnet is so much cheaper cause it does not have intermediate reasoning.
Problem
With the release of OpenAI o1-preview and o1-mini, the costs also include internal reasoning tokens. Therefore, pricing comparisons with classical one-shot models is not possible. I.e. o1-mini costs $15 and Sonnet 3.5 costs $18 but Sonnet is so much cheaper cause it does not have intermediate reasoning.
Solution (optional)
Track the actual tokens of each query from the model response according to https://platform.openai.com/docs/api-reference/chat/object and save them to the CSV.