enricoros / big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.
https://big-agi.com
MIT License
4.83k stars 1.09k forks source link

[BUG] constant unrequested call to {diagram model} #560

Closed kaptainkangaroo closed 2 days ago

kaptainkangaroo commented 1 month ago

Description

Issue: an unrequested call to the secondary diagram model is made every time the chat button is clicked. resulting in extra charges

Step 1. Configure Model settings with OpenRouter account. Step 2. set Auto diagram to include "Phind: CodeLlama 34B v2" (see screenshot) Step 3. start a session and click chat button , (in a session with ANY LLM model) Step 4. See the extra charge on the activity page on OpenRouter (https://openrouter.ai/activity?page=1)

image

screenshot: shows an additional call to "Phind: CodeLlama 34B v2" even when the free version of mistral is called

image

Device and browser

m1 Macbook Air, OS: 13.6.6 (22G630) Chrome: Version 125.0.6422.142 (Official Build) (arm64) BIG AGI: 1.16.1

Screenshots and more

Willingness to Contribute

enricoros commented 1 month ago

@kaptainkangaroo please try the following:

  1. Check if the call is from the Auto-Title:

    • [ ] switch off auto-title for chats
    • [ ] check if the secondary call (with a different model) is made image
  2. Make sure the "Auto Diagrams" is off as well.

    • [ ] with both auto-title and auto-diagrams off, please check the network requests
    • [ ] if there's a second network request, look into the prompt (example in chrome below)

image

Let me know once you're done.

enricoros commented 4 weeks ago

Let me know if you were able to solve @kaptainkangaroo or we'll close for inactivity as support has been provided.

enricoros commented 2 days ago

Closed for inactivity, and support has been provided.