search

datastax / cassandra-data-migrator

Cassandra Data Migrator - Migrate & Validate data between origin and target Apache Cassandra®-compatible clusters.
Apache License 2.0
28 stars 18 forks source link

Ignore computing writetime (& TTLs) for tables without non-primary key columns #245

Open msmygit opened 8 months ago

msmygit commented 8 months ago

Ignore computing writetimes (& TTLs) when there are no writetime capable columns in the given table schema.

Currently we hit this error which stems from this condition,

24/02/05 15:32:07 ERROR WritetimeTTL: WriteTimestamp filter is configured but no WriteTimestamp columns are de
fined
24/02/05 15:32:07 INFO WritetimeTTL: Feature WritetimeTTL is disabled
24/02/05 15:32:07 ERROR CopyJobSession: Feature com.datastax.cdm.feature.WritetimeTTL is not valid.  Please ch
eck the configuration.
24/02/05 15:32:07 INFO WritetimeTTL: PARAM -- spark.cdm.filter.java.writetime.min: 1668470400000 datetime is 1
970-01-20T07:27:50.400Z 
24/02/05 15:32:07 INFO WritetimeTTL: PARAM -- spark.cdm.filter.java.writetime.max: 2699474926455700 datetime i
s 2055-07-17T22:08:46.455Z
pravinbhat commented 3 days ago

@msmygit Can you review this issue. I think this issue has been resolved as part of 4.6.0 release