search

awslabs / amazon-kinesis-scaling-utils

The Kinesis Scaling Utility is designed to give you the ability to scale Amazon Kinesis Streams in the same way that you scale EC2 Auto Scaling groups – up or down by a count or as a percentage of the total fleet. You can also simply scale to an exact number of Shards. There is no requirement for you to manage the allocation of the keyspace to Shards when using this API, as it is done automatically.
Apache License 2.0
338 stars 95 forks source link

Lambda support #40

Open frohoff opened 8 years ago

frohoff commented 8 years ago

It would be great if this could be run as a scheduled lambda function instead of on EC2/EB. Though I did notice that there's already a LambdaApp branch, I didn't see any obvious or documented way to do this.

pgieser commented 8 years ago

I had wondered this as well, but assumed that it was not implemented because any autoscaling wouldn't necessarily finish in the 5 minutes that a lambda has available. Also, you would have to keep track of a fair amount of state between executions (not impossible, but starts to make it less appealing I suppose).

IanMeyers commented 5 years ago

Yeah - today this isn't possible as it would need to run forever. I would happily take a PR for a version that ran a single cycle of the StreamMonitor using CloudWatch Events on a tight schedule, if someone is interested in a hobby project.

racheliurui commented 3 years ago

what about prebuilt docker image can run using fargate

igilham commented 2 years ago

Old news now, but for the sake of helping newcomers, a Lambda solution has been published.