search

amazon-archives / dynamodb-import-export-tool

Exports DynamoDB items via parallel scan into a blocking queue, then consumes the queue and import DynamoDB items into a replica table using asynchronous writes.
Apache License 2.0
90 stars 38 forks source link

Table scan "completes" in a minute, with just a handful of records copied #16

Open mikebrules opened 6 years ago

mikebrules commented 6 years ago

Hello I'm trying to understand what a reasonable set of config for the tool looks like - I suspect I am misunderstanding the "ratio" params. The comments in the source-code say 

Percentage of total read throughput to scan the source table

....and so, for my test, 100.0 seems a valid number for source and destination. My source table has ~7200 items in it, but when I run the tool, I get ~60 items copied to my destination table and the process completes (exit code 0) - no errors

Am I misunderstanding something?

Thanks

simrandeep11 commented 5 years ago

@mikebrules By my experience of using this utility the ratio value should be between 0-1. I agree the helper text is misleading.