search

YahooArchive / omid

Transactional Support for HBase (Mirror of https://github.com/apache/incubator-omid)
http://omid.incubator.apache.org/
Apache License 2.0
302 stars 107 forks source link

Concurrent CT write #75

Closed ohadshacham closed 8 years ago

ohadshacham commented 8 years ago

Scaling up the TSO by parallelizing the batched writes to the commit table. The architecture mostly changed by adding batch events and creating handlers under PersistenceProcessorImpl. This commit increases the performance of Omid from 55K tps to 380K tps when using 6 region servers.

Please note that the addition of MonitoringContext significantly degrades performance and therefore, should becomes optional to achieve good performance.

ikatkov commented 8 years ago

Overall the idea is very good!

ikatkov commented 8 years ago

Given my comments above LGTM. We will need to rebase it though.

ikatkov commented 8 years ago

Code moved to a new branch. https://github.com/yahoo/omid/pull/89