[Feat- prometheus] track input and output tokens

[ishaan-jaff]

Title

{
  "total_tokens": {
    "value": 168.0,
    "labels": {
      "api_key_alias": "None",
      "end_user": "None",
      "hashed_api_key": "88dc28d0f030c55ed4ab77ed8faf098196cb1c05df778539800c9f1243fe6b4b",
      "model": "gemini-1.5-pro",
      "team": "None",
      "team_alias": "None",
      "user": "default_user_id"
    }
  },
  "input_tokens": {
    "value": 15.0,
    "labels": {
      "api_key_alias": "None",
      "end_user": "None",
      "hashed_api_key": "88dc28d0f030c55ed4ab77ed8faf098196cb1c05df778539800c9f1243fe6b4b",
      "model": "gemini-1.5-pro",
      "team": "None",
      "team_alias": "None",
      "user": "default_user_id"
    }
  },
  "output_tokens": {
    "value": 153.0,
    "labels": {
      "api_key_alias": "None",
      "end_user": "None",
      "hashed_api_key": "88dc28d0f030c55ed4ab77ed8faf098196cb1c05df778539800c9f1243fe6b4b",
      "model": "gemini-1.5-pro",
      "team": "None",
      "team_alias": "None",
      "user": "default_user_id"
    }
  }
}

Relevant issues

Type

🆕 New Feature 🐛 Bug Fix 🧹 Refactoring 📖 Documentation 🚄 Infrastructure ✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locall

If UI changes, send a screenshot/GIF of working UI fixes

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Sep 19, 2024 0:03am