datastax / dsbulk-migrator

Apache License 2.0
9 stars 8 forks source link

Upgrade DSBulk to 1.8.0 and use new built-in support for TTL and cell timestamp #11

Open sync-by-unito[bot] opened 1 year ago

sync-by-unito[bot] commented 1 year ago

DSBulk 1.8.0 has just been released. This version adds the ability to automatically preserve cell timestamps and TTLs with two easy-to-use options.

This capability is already built into the current historical data migrator, which generates the "low-level" DSBulk commands to achieve this with DSBulk 1.7.0. The resulting CQL queries that are generated are identical, so there is no difference from an efficiency point of view. However, upgrading to 1.8.0 and using the new capability would allow us to make the scripts and commands smaller and easier to read, and also the migrator code easier to maintain.

Not an urgent change but something to get round to doing eventually.

┆Issue is synchronized with this Jira New Feature by Unito ┆Components: Schema Migrator ┆Priority: Major

sync-by-unito[bot] commented 1 year ago

➤ Alice Lottini commented:

The DSBulk version has been upgraded but I don’t think we changed the migrator to use the new built-in support for TTL and cell writetime.