dust-tt / dust

Amplify your team's potential with customizable and secure AI assistants.
https://dust.tt
MIT License
899 stars 98 forks source link

[Multi Actions] Fix bug where assistant tries to use tool even if not allowed #5839

Closed fontanierh closed 1 week ago

fontanierh commented 1 week ago

Mostly observed on 3.5 sonnet. Could be related to system prompt We could decide to:

fontanierh commented 1 week ago

It is somewhat similar to https://github.com/dust-tt/tasks/issues/940

fontanierh commented 1 week ago

Anyway, this starts with a good repro.

We have the run here: https://dust.tt/w/78bda07b39/a/0e9889c787/runs/18eee44fd1511f2c767f031dac494afb588217cffb0a23c0e1c77db32518a24d

Now we need to reproduce it

spolu commented 1 week ago

As per IRL, first step is really to ensure we have a digestible error for users that invites them to retry. Is that the case right now?

From there we can optimize with Anthropic to prevent this as much as possible.

fontanierh commented 1 week ago

@spolu we have the one you added here: https://github.com/dust-tt/dust/blob/3e2281e2eb3b6e048a109a318d4c04ded4612f57/front/lib/api/assistant/agent.ts#L649

spolu commented 1 week ago

Maybe we should add a sentence to invite to retry in that case?