Add support for amazon-bedrock-guardrailConfig

langchain-ai / langchain-aws

Build LangChain Applications on AWS

MIT License

95 stars 70 forks source link

Add support for amazon-bedrock-guardrailConfig #59

Open supreetkt opened 4 months ago

supreetkt commented 4 months ago

Add support for amazon-bedrock-guardrailConfig

Adds guardrailConfig to hold values for this field within the guardrails property for Bedrock classes and this is passed to the bedrock invoke model calls via the amazon-bedrock-guardrailConfig field in the body. amazon-bedrock-guardrailConfig allows adding a tagSuffix [documentation] and different streaming response behaviors [documentation]
Also cleaned up some documentation, error messages and tests
Added a conftest file for common fixtures that can be used across tests

Closes: #52

supreetkt commented 4 months ago

@3coins: can we trigger the workflow checks on this PR? Thanks.

nbaillie commented 3 months ago

is there any idea when this might be released?

supreetkt commented 3 months ago

is there any idea when this might be released?

I haven't heard back from @3coins yet, but hopefully soon!

paulonasc commented 3 months ago

@3coins any updates on this PR? I need this feature ASAP. Please let me know if I can help :)

3coins commented 3 months ago

@supreetkt Can you fix conflicts and rebase from main.

fpSpindola commented 2 months ago

hey guys! Is there any chance this is going to be released soon?

john-mihailescu commented 1 month ago

Does this actually work with streaming? I'm finding that even with these changes, whether I use asynchronous or synchronous streaming with the Anthropic bedrock models in langchain, as soon as I include guardrails I get the results in a single chunk rather than streaming out the response in smaller chunks gradually.

KimYongKuk commented 1 month ago

I really hope this gets implemented soon.