search

langchain-ai / langsmith-docs

Documentation for langsmith
https://docs.smith.langchain.com/
MIT License
76 stars 32 forks source link

DOC: <Issue related to /how_to_guides/tracing/log_llm_trace> #340

Open YassineRjl opened 2 months ago

YassineRjl commented 2 months ago

Hi there, I'm using RunTree and want to log the cost, I figured out how to add the token count but not the cost. Can someone guide me please?

PS: The provider openai and gpt-4 are just values to test with. I figured if it works for them it'll work for the other custom models I'm using like Command-R

Reference: https://docs.smith.langchain.com/how_to_guides/tracing/log_llm_trace#manually-provide-token-counts

   trace.end({
      data,
      usage_metadata: {
        input_tokens: 27,
        output_tokens: 13,
        total_tokens: 40,
        total_cost: ((inCost ?? 0) + (outCost ?? 0)),
        prompt_cost: inCost,
        completion_cost: outCost,
      },
      ls_provider: 'openai',
      ls_model_name: 'gpt-4',
    });
hinthornw commented 2 months ago

Hi there! Cost is added in the UI via the models page