search

ray-project / llm-numbers

Numbers every LLM developer should know
4.06k stars 138 forks source link

Fine tune cost numbers #2

Closed smy20011 closed 1 year ago

smy20011 commented 1 year ago

It costs you 6 times as much to serve a fine tuned model as it does the base model on OpenAI.

Do you have any data about it? Is it because the training cost?

waleedkadous commented 1 year ago

From the OpenAI prices:

image

See how Davinci is $0.02/ktoken for instruct GPT but $0.12/ktoken? 0.12/0.02 = 6.

smy20011 commented 1 year ago

Got it. I thought It's for open source LLMs.