(bedrock): CDK construct for creating custom Bedrock models

awslabs / generative-ai-cdk-constructs

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

https://awslabs.github.io/generative-ai-cdk-constructs/

Apache License 2.0

367 stars 50 forks source link

(bedrock): CDK construct for creating custom Bedrock models #700

Open rinaudjaws opened 2 months ago

rinaudjaws commented 2 months ago

Describe the feature

Create a construct to enable fine tuning of Bedrock models with enterprise data.

Use Case

I want to train a new Bedrock model with existing enterprise data.

Proposed Solution

This requires use of custom resources (as no there's no support for CloudFormation for CreateModelCustomizationJob).

Other Information

Use other solutions like aiops-modules's bedrock fine tuning.

Acknowledgements

[X] I may be able to implement this feature request
[ ] This feature might incur a breaking change

krokoko commented 1 month ago

Hi @rinaudjaws thank you for this ticket, the link you mentioned seems to provide already a CDK construct for that purpose. Is the ask to have a different delivery mechanism for that mentioned solution (this library in addition to seedfarmer cli) ? @kukushking what do you think ? we could make your fine tuning module also part of this library

rinaudjaws commented 1 month ago

The solution I linked is a stack and not a construct (I would need to copy/maintain code which increases complexity of the solutions) or figure out a way to integrate both solutions (aiops-modules with generative-ai-cdk-constructs).

I see value implementing a similar approach directly within generative-ai-cdk-constructs (otherwise customers will need to implement it themselves, in which case it will look 99% similar to aiops approach)