search

awslabs / generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.
https://awslabs.github.io/generative-ai-cdk-constructs/
Apache License 2.0
337 stars 51 forks source link

Knowledge base: support to invoke LLM on other region #522

Closed statefb closed 3 days ago

statefb commented 3 months ago

Describe the feature

The current implementation library does not support invoking AI models from a different region than the one where the Knowledge Base (KB) and other resources are deployed.

Use Case

claude3 only supports limited regions.

Proposed Solution

No response

Other Information

I may be able to implement this feature request, but I have other preoritized tasks, so I cannot promise the timeline to develop it.

Acknowledgements

krokoko commented 3 days ago

Closing this as the feature it is a duplicate of the current work with inference profiles