search

aws / aws-cdk

The AWS Cloud Development Kit is a framework for defining cloud infrastructure in code
https://aws.amazon.com/cdk
Apache License 2.0
11.41k stars 3.8k forks source link

Stabilize Kinesis Firehose module #7536

Open SomayaB opened 4 years ago

SomayaB commented 4 years ago

Add your +1 đź‘Ť to help us prioritize high-level constructs for this service

Overview:

Amazon Kinesis Data Firehose is a fully managed service for delivering real-time streaming data to destinations such as Amazon Simple Storage Service (Amazon S3), Amazon Redshift, Amazon Elasticsearch Service (Amazon ES), and Splunk.

AWS Docs

Maturity: CloudFormation Resources Only

See the AWS Construct Library Module Lifecycle doc for more information about maturity levels.

Implementation:

See the CDK API Reference for more implementation details.

Issue list:

flemjame-at-amazon commented 4 years ago

This might belong in another module, but I can think of design patterns for Kinesis that might be useful to have constructs for, maybe in a kinesis-patterns module.

One that I saw in a chat was CloudWatch Logs archiving to S3, by streaming to Kinesis Firehose.

sachin10101998 commented 3 years ago

Any update on this?

iliapolo commented 3 years ago

Hi @sachin10101998 - This is currently not prioritized, once it will we will update this issue with the planned work. We would gladly accept contributions though :)

skyrpex commented 2 years ago

Should https://github.com/aws/aws-cdk/issues/14391 be in this list? It relates to Kinesis Firehose although the code will likely live in the SNS Subscriptions package.

BenChaimberg commented 2 years ago

Thanks for pointing that out, we'll add it to the list! (Along with #14918.)

flipch commented 2 years ago

Is this tracking dynamic partitioning support as well?

Using JQ - Applying S3 Path destinations

kilitr commented 1 year ago

Is support for modifying buffer hints in the cdk construct of deliveryStreams also gonna be part of this list?

github-actions[bot] commented 4 months ago

This issue has received a significant amount of attention so we are automatically upgrading its priority. A member of the community will see the re-prioritization and provide an update on the issue.

DeltaByte commented 3 weeks ago

Is this still being worked on actively? Given other parts of cdk are now showing deprecation warnings that require migrating to the L2 Firehose constructs I hope the remaining missing features (e.g. Glue format conversion) are at least added into the alpha lib at some point soon.