Unable to ask question that uses two tools with streamText and AWS Bedrock

andreasdurietztibber commented 2 weeks ago

Description

We ran into two unexpected things that both work well when using generateText but not with streamText.

We have tools that don't really have parameters. So we would put parameters: z.object({ }),. Doing so makes the streamText simply stop after the first tool call, without any additional information.
When we put dummy params like parameters: z.object({ query: z.string() }), and ask a question that would require both tools if fails with an error.

Error message

AI_InvalidToolArgumentsError: Invalid arguments for tool sun: JSON parsing failed: Text: {"query": "Where does the user live?"}{"query": "What color is the sun?"}.
Error message: JSON Parse error: Unable to parse JSON string

We can get around that by putting parameters: z.record(z.string(), z.string()), as parameter but it seems like a strange workaround when we don't even want a parameter.

Code example

import { streamText, tool } from "ai";
import { z } from "zod";
import { createAmazonBedrock } from "@ai-sdk/amazon-bedrock";
import { defaultProvider } from "@aws-sdk/credential-provider-node";

(async () => {
  console.log("Debugging the bot");
  const bedrock = createAmazonBedrock({
    bedrockOptions: { credentials: defaultProvider(), region: "eu-central-1" },
  });
  const model = bedrock("anthropic.claude-3-5-sonnet-20240620-v1:0");

  const result = await streamText({
    model,
    tools: {
      house: tool({
        description: "Has information about where the user lives",
        parameters: z.object({ query: z.string() }),
        execute: async () => {
          return { address: "10 downing street" };
        },
      }),
      sun: tool({
        description: "Knows things about the sun",
        parameters: z.object({ query: z.string() }),
        execute: async () => {
          return "The sun is yellow and really hot";
        },
      }),
    },
    prompt: "Where do I live and what color is the sun?",
    maxToolRoundtrips: 4,
  });

  for await (const textPart of result.textStream) {
    console.log(textPart);
  }
})();

Additional context

The problem with empty params stopping the streamText seem to be present for both bedrock & anthropic provider. However the problem with params failing the JSON parsing only seem to be present with @ai-sdk/amazon-bedrock but not with @ai-sdk/anthropic.