(aws-msk): Support newer versions of Kafka

[stefanfreitag]

Describe the feature

CDK supports at the moment Kafka versions until v2.8.1 (see packages/@aws-cdk/aws-msk/lib/cluster-version.ts). MSK itself added support for

• Apache Kafka version 3.3.1
• Apache Kafka version 3.2.0
• Apache Kafka version 3.1.1
• Amazon MSK tiered storage version 2.8.2.tiered

(see https://docs.aws.amazon.com/msk/latest/developerguide/supported-kafka-versions.html)

These new versions should be enabled also in the CDK.

Use Case

Within the next few month I need to migrate self-managed Kafka clusters to MSK. Here I would like to go with CDK and Kafka v3.x

Proposed Solution

The change could be implemented by enhancing the KafkaVersions class. There is one additional change as tiered storage was introduced with 2.8.2- not sure how to treat this one.

Other Information

• https://aws.amazon.com/about-aws/whats-new/2022/10/amazon-msk-offers-low-cost-storage-tier-scales-virtually-unlimited-storage/
• MSK Create Cluster CLI command

Acknowledgements

• [X] I may be able to implement this feature request
• [ ] This feature might incur a breaking change

CDK version used

2.62.2

Environment details (OS name and version, etc.)

Ubuntu 22.04

[pahud]

Yeah I think we could add the versions in the KafkaVersion class. Thank you for your PR contribution.

[stefanfreitag]

The tiered storage requires to my understanding an additional property in the construct - at the moment I will leave out the version 2.8.2.tiered and go only with 3.1.1, 3.2.0, and 3.3.1.

[github-actions[bot]]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see. If you need more assistance, please either tag a team member or open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.