fix guardrail attributes when invoking bedrock

[brnaba-aws]

Fixed bedrock attributes when using guardrails. See example of usage:

from langchain_core.messages import HumanMessage
from langchain_aws.chat_models import ChatBedrock

llm_model_id='anthropic.claude-3-haiku-20240307-v1:0'

chat = ChatBedrock(
    model_id=llm_model_id,
    streaming=True,
    model_kwargs={"temperature": 0.1},
    guardrails={"guardrailIdentifier": "identifier", "guardrailVersion": "1", "trace": True},
)

messages = [
    HumanMessage(
        content="What are the financial advice you can give me?"
    )
]
for chunk in chat.stream(messages):
    print(chunk.content,  end="", flush=True)

[brnaba-aws]

@3coins This is the PR for guardrails with the new structure. Can you please have a look? Thanks.

[3coins]

@brnaba-aws Thanks for making this update. This looks like a breaking change, does Bedrock have a version that works with the previous format or all clients need to move to this new API? Also, can you add some unit tests for this, or paste your test results here.

[nagelpat]

Looking forward to get this fix merged for the GA version of Guardrails for Amazon Bedrock.

This looks like a breaking change, does Bedrock have a version that works with the previous format or all clients need to move to this new API?

Is backward compatibility needed for the "Preview" version of Guardrails?

[MaverickScientist]

langchain-aws version used: 0.1.4

Have tried all the below scenarios:

1. guardrails={ "trace": False, "accept": "application/json", "contentType": "application/json", "modelId": model_id, "guardrailIdentifier": "identifier", --> "id" of the Guardrail I created using Bedrock Console. "guardrailVersion": "5"}

2. guardrail_kwargs={"guardrailIdentifier": "identifier", "guardrailVersion": "5"}

3. guardrails={ "trace": False, "guardrailIdentifier": "xxxx" --> the ARN of the guardrail I created using Bedrock Console. "guardrailVersion": "5"}

4. guardrails={ "trace": False, "guardrailIdentifier": "identifier", --> "id" of the Guardrail I created using Bedrock Console. "guardrailVersion": "5"}

Adding the exception below:

1. 2024-05-19 15:27:29,346 ERROR root ScriptRunner.scriptThread : Error Occured: Error raised by bedrock service: Parameter validation failed: Unknown parameter in input: "guardrailIdentifier", must be one of: body, contentType, accept, modelId Unknown parameter in input: "guardrailVersion", must be one of: body, contentType, accept, modelId

Tried the alternative as below: guardrails={ "trace": False, "id": "identifier", --> "id" of the Guardrail I created using Bedrock Console. "version": "5"}

Got the exception as below:

Error Occured: Guardrails must be a dictionary with 'guardrailIdentifier' and 'guardrailVersion' keys.

The below option doesn't give any error but eventually has no relevance as the identifier value is None:

guardrails={ "trace": False, "guardrailIdentifier": None "guardrailVersion": "5"}

Please suggest the correct way of passing the guardrail parameter for it to work.

PS: I have tested the Guardrail from Bedrock Console and it works like a charm.

[MaverickScientist]

Followed your example, getting the same error

[brnaba-aws]

@MaverickScientist Which version of boto3 do you use? It seems like the version you have is not the latest. If you use a lambda, verify the boto3 version and if it is not a version that supports guardrails attributes, package your lambda with the latest version of boto3.

[MaverickScientist]

Moving to boto 1.34.108 fixed it.