danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.
https://librechat.ai/
MIT License
19.41k stars 3.24k forks source link

[Question]: Unexpected, phantom calls to Claude API #4695

Closed serefarikan closed 2 weeks ago

serefarikan commented 2 weeks ago

What is your question?

How can I check if a call to Claude API actually came from my Librechat deployment?

More Details

I have LibreChat running via the docker compose deployment. It is running under Ubuntu linux, behind nginx, which does the ssl termination.

Sometimes, but not always, I see entries in anthropic dashboard's log section with time stamps corresponding to times when I was not using Librechat. During some of these even the computer is not on, but the requests are there and they are costing me. The API key used by LibreChat is not used anywhere else. I deleted the key, recreated it and done this a few times now.

Some of the log entries are pointing at claude-3-haiku-20240307 model, which is not even configured in my Librechat deployment!

My Librechat deployment will ask for a login when the deployment url is visited, so I cannot see how some random bot can find it and use it.

This is driving me mad. Is is the anthropic dashboard that is lying to me? Am I being charged by them incorrectly, even if the requests are not made by my Librechat deployment?

I'd love to know how I can keep track of my calls on the Librechat side so that I can at least confirm the calls were made from Librechat. Any other suggestions are most welcome.

What is the main subject of your question?

Other

Screenshots

No response

Code of Conduct