hmsonline / storm-cassandra

Storm Cassandra Integration
Apache License 2.0
180 stars 90 forks source link

Implement Batched Updates #4

Closed ptgoetz closed 12 years ago

ptgoetz commented 12 years ago

Provide an option to batch updates to cassandra. The current implementation writes a single update to Cassandra for each Storm tuple received.

It would be better, especially when under heavy load, to cache/batch updates until a certain threshold is reached (update count and/or temporal threshold), and then process updates.