search

scylladb / scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra
Apache License 2.0
54 stars 34 forks source link

Migrator does not create Indexes based on DynamoDB table #99

Open hopugop opened 11 months ago

hopugop commented 11 months ago

When inferring schema from base DynamoDB table, Migrator skips indexes creation. Indexes cannot be created after the fact, so users have to resort to manually create the schema + indexes prior migrating. Migrator should create Indexes along the base table, so they are properly populated.

julienrf commented 1 month ago

Indexes should be available from the output of describe-table. We should be able to use that information to re-create the indexes on the target table.

julienrf commented 5 days ago

While working on this, I hit https://github.com/scylladb/scylladb/issues/19716 which makes it difficult to check whether the schema of a table has been correctly replicated or not.