Question: Does Bedrock LLMs API support `.with_structured_output` method?

langchain-ai / langchain-aws

Build LangChain Applications on AWS

MIT License

63 stars 47 forks source link

Question: Does Bedrock LLMs API support `.with_structured_output` method? #34

Closed iferca closed 2 months ago

iferca commented 2 months ago

I'm trying to use bedrock to extract information from documents, and I'd like to use Structured Output since there are bedrock's available models that support it. Either I'm doing something wrong or it is not supported operation by Bedrock, my code is failing with NotImplemented error. I was planning to consolidate API, costs, etc in Bedrock but at the moment I'm forced to use other providers.

Any hint would be greatly appreciated.

iferca commented 2 months ago

Closing this, I just realized in langchain this is marked as beta still, so I wouldn't expect bedrock support at this stage.