search

JeremyGrosser / tablesnap

Uses inotify to monitor Cassandra SSTables and upload them to S3
BSD 2-Clause "Simplified" License
181 stars 86 forks source link

Store data compressed #48

Closed huahaiy closed 9 years ago

huahaiy commented 9 years ago

Each put to S3 cost money. It's better to group files into a batch and compress the data before pushing to S3.

JeremyGrosser commented 9 years ago

The default behavior of cassandra is to compress sstables before they're written to disk, so the data tablesnap is uploading is already in a compressed form unless you disabled that functionality within cassandra.