scylladb / kafka-connect-scylladb

Kafka Connect Scylladb Sink
Apache License 2.0
42 stars 22 forks source link

Fix table compression #98

Open Bouncheck opened 8 months ago

Bouncheck commented 8 months ago

Currently setting table compression fails with Missing sub-option 'sstable_compression' for the 'compression' option.. This is due to Cassandra using now 'class' sub-option and Scylla using 'sstable_compression'. Resolved by calling with customized 'withOption' instead of directly 'withCompression'.

Upgrades snappy to 1.1.10.5. This technically also requires upping the driver version to the one using snappy 1.1.10.5.

Bouncheck commented 8 months ago

No issues observed when running with LZ4, Deflate, Snappy and no table compression. No issues observed with Snappy protocol compression.