[BUG] - unable to run claude models in us-west-2

tnh commented 2 months ago

Describe the bug

Filling out this field will help us investigate the issue efficiently. Providing detailed information allows us to set the appropriate priority. We appreciate your cooperation.
A clear and concise description of what the bug is.

To Reproduce

setting AWS_DEFAULT_REGION=us-east-2
closing repo
running ./bin.sh

Then I was unable to access any model - and would see the following

I have access to all the models in the us-east-2 region:

the model id does seem like the same model id:

I see the following two log messsages in the cloudwatch logs for the Websocket Lambda:

This is the message in the browser on the client side of the WSS call:

"{\"conversationId\":\"01HWKDG43PGTFQNRP1Y9WK45TM\",\"message\":{\"content\":[{\"body\":\"test\",\"contentType\":\"text\"}],\"model\":\"claude-v3-opus\",\"role\":\"user\",\"feedback\":null,\"parentMessageId\":\"system\"},\"token\":\"eyJraWQiOiJzY2k0aWMxUXZEVTEwU2lUM2gyRnNUZ1dBTVM5ZlNsVFErK0g3cUlcL21GND0iLCJhbGciOiJSUzI1NiJ9.eyJzdWIiOiI3OGIxMjNmMC1lMDkxLTcwNTAtZTIxOC01OWRhNTMzZWFhZmUiLCJjb2duaXRvOmdyb3VwcyI6WyJBZG1pbiIsIlB1Ymxpc2hBbGxvd2VkIl0sImVtYWlsX3ZlcmlmaWVkIjp0cnVlLCJpc3MiOiJodHRwczpcL1wvY29nbml0by1pZHAudXMtd2VzdC0yLmFtYXpvbmF3cy5jb21cL3VzLXdlc3QtMl9DbzcxbUpzSXAiLCJjb2duaXRvOnVzZXJuYW1lIjoiNzhiMTIzZjAtZTA5MS03MDUwLWUyMTgtNTlkYTUzM2VhYWZlIiwib3JpZ2luX2p0aSI6ImYwNGM2ZmYwLTY5YTItNGQxOC1hMDdmLTIwYmQ2MjlkYTExNyIsImF1ZCI6IjZwaDZ0Z3RrZjQ1a3I5Mm0xOG85dHNxbGwiLCJldmVudF9pZCI6ImUzOGVjNDZkLWE5MTUtNDA5YS04YmRkLTZiNTViNjc4ODQ1YyIsInRva2VuX3VzZSI6ImlkIiwiYXV0aF90aW1lIjoxNzE0MjA0MzEwLCJleHAiOjE3MTQ0MjkzODQsImlhdCI6MTcxNDM0Mjk4NCwianRpIjoiMDQzOWI3NGEtNDEyMS00ZWZjLThhY2YtZTk4ZmM1MTljNGY2IiwiZW1haWwiOiJ0aG9ybmlicm9va0BzZWVrLmNvbS5hdSJ9.BPwjF8w8M0PAAnZa-wg0SVAaXWM1RcPuznv4gbzy6AA-OAoFb14X-i27vYiKaLdkzRzBAb2KTCIs1h50BBirz5bbR41q_cikjBw5tpReaj78XyvVhwvDVWd7DiwjwbPYx_vWw-qTiC8vmKXvTWDRq86WYduJO9ny6oyyHUqbkaIeNJqT2VQ7Yitflw___FoTQIaqvH27hj17HJjUCXuLn_MljeEHgUaYP7x7tbfisQt5DGxa35PQ66fvvSHlirDlHOGtWFw2DdbG07L1l0XcfDZAVlM9_PYv0ppiuNpUGXT6Q5t0axx4Jc354OBUWKgNS5txyELOAfRr2HH_MTZwdw\"}"

Additional context

Add any other context about the problem here.

statefb commented 2 months ago

Could you please let me know Sonnet / Haiku are available?

prometheusresearchlabs-partha commented 1 month ago

Hello, I have the exact same error as tnh, and to confirm, I also have Haiku and Sonnet enabled, these are working fine in the Chat, Opus is not and is showing the same error as above, if you require any further context, please let me know

statefb commented 1 month ago

Have both of you modified bedrockRegion to us-west-2?
ref: https://github.com/aws-samples/bedrock-claude-chat#deploy-using-cdk

prometheusresearchlabs-partha commented 1 month ago

Yes, Claude 3 Opus is only available in Oregon hence bedrockRegion is set to us-west-2 in cdk.json, I also tried again and replaced any instance of us-east-1 to us-west-2 and still have this error. Also tried in multiple AWS accounts just in case

github-actions[bot] commented 1 month ago

This issue has been labeled as "stale" due to no response by the reporter within 1 month (and 14 days after last commented by someone). And it will be closed automatically 14 days later if not responded.

github-actions[bot] commented 2 weeks ago

This issue has been closed due to no response within 14 days after labeled as "stale", 14 days after last reopened, and 14 days after last commented.

aws-samples / bedrock-claude-chat