aws-samples / cql-replicator

CQLReplicator is a migration tool that helps you to replicate data from Cassandra to AWS Services
Apache License 2.0
15 stars 8 forks source link

migrate uncompressed data from Cassandra/Keyspaces to compressed Keyspaces #117

Closed naveenkantamneni closed 7 months ago

naveenkantamneni commented 8 months ago

Is your feature request related to a problem? Please describe. No. This is a new feature request

Describe the solution you'd like It would be helpful to have compression option available when migrating from Cassandra to Keyspaces or from Keyspaces to compressed Keyspaces

Describe alternatives you've considered Compress data during migration

Additional context None.

nwheeler81 commented 8 months ago

@naveenkantamneni [] Plan the JSON mapping what columns go "as is" and what columns should be serialized to JSON and compressed. The primary key stays the same. [] Compression algorithms: LZ4 Fast Compressor, GZIP, ZSTD with different compression levels