search

YahooArchive / omid

Transactional Support for HBase (Mirror of https://github.com/apache/incubator-omid)
http://omid.incubator.apache.org/
Apache License 2.0
302 stars 107 forks source link

Concurrent CT write #89

Closed ikatkov closed 8 years ago

ikatkov commented 8 years ago

Moved branch ohadshacham:concurrentCTwrite to omid repo. No other changes. Old PR - https://github.com/yahoo/omid/pull/75

Rebased, please comment below.

caling up the TSO by parallelizing the batched writes to the commit table. The architecture mostly changed by adding batch events and creating handlers under PersistenceProcessorImpl. This commit increases the performance of Omid from 55K tps to 380K tps when using 6 region servers.

Please note that the addition of MonitoringContext significantly degrades performance and therefore, should becomes optional to achieve good performance.

francisco-perez-sorrosal commented 8 years ago

Squashed previous mess of commits into commit https://github.com/yahoo/omid/pull/89/commits/db84845872de501111a604224325d13611db8b4e

francisco-perez-sorrosal commented 8 years ago

Rebased on top of current master on commit f6220a8