Pricing

[tischi]

https://openai.com/pricing

gpt-3.5 is 20x cheaper than gpt-4.0, quite a difference!

[haesleinhuepf]

And only chatGPT 3.5 can be fine-tuned at the moment (#6 )

[tischi]

Interesting.

I think it would be good to count the number of tokens during a chat session and always also output how much the question and answer cost. What do you think? Is that technically possible?

[haesleinhuepf]

I'm not sure. I didn't measure it so precisely, but playing with a notebook for an hour commonly costs 1-5 ct.

[tischi]

My question would be whether this is 20x more expensive when you use gtp4.0 instead of gpt3.5 ...

Did you try this? Can we even get the costs for one session somehow?

[tischi]

I implemented token counting like this: https://www.educative.io/answers/how-to-count-tokens-before-sending-an-api-request-to-chatgpt

Now it would be nice to also obtain the prices: https://community.openai.com/t/is-the-current-model-pricing-available-via-the-api/406893

[tischi]

Seems that this is currently now available and we have to manually maintain a list of the prices, which I already did by implementing a Models class.

https://community.openai.com/t/is-the-current-model-pricing-available-via-the-api/406893/2

[haesleinhuepf]

If we put pricing in, it would be great if

• this is an optional feature, users have to OPT-IN to see pricing-related output
• The code lives in a separate _pricing.py to keep it separate

[haesleinhuepf]

See PR #24 for code doing this