awslabs / amazon-dynamodb-tools

Tools to make effective use of DynamoDB easier.
Apache License 2.0
121 stars 26 forks source link

Amazon DynamoDB Table migration project #45

Open tebanieo opened 11 hours ago

tebanieo commented 11 hours ago

DynamoDB Migration project

We need a project that helps with the migration of DynamoDB tables. In the DynamoDB Documentation we have a guide on how to do it, but up to date there is no a project/tool that assist with this task, leaving users designing the solution on their own.

The concept is very simple, migrate a DynamoDB table with near zero downtime.

The project/solution/tool will:

Dear community feel free to add more requirements, or comments as you see fit.

Thanks!

### Tasks
- [ ] Use CDK as it is easy to convert into an L3 construct that can be imported and re-used
- [ ] Prefer serverless components
- [ ] Avoid interference with the Source DynamoDB table performance
- [ ] Migrate table data only, continue to replicate CDC (Change data capture) to the destination
- [ ] Avoid loosing CRUD operations, 100% success rate.
- [ ] Process the updates in the same order than the source table.
- [ ] The solution is eventual consistent
- [ ] Add support for different throughput requirements
terhunej commented 11 hours ago

.