search

ashwanthkumar / suuchi

सूचि - Toolkit to build Distributed Data Systems
https://ashwanthkumar.github.io/suuchi/
53 stars 12 forks source link

Scalecube based membership #48

Closed ashwanthkumar closed 8 years ago

ashwanthkumar commented 8 years ago

Extracting membership implementations as a separate library. I just stumbled upon this library today - Scalecube. I was looking for implementations of Gossip based membership and these guys implement SWIM in that library.

I took this opportunity to remove atomix also from the core and added it as a separate module.

@brewkode This is also making making baby steps towards rebalancing ( #49 ) following the progress on #43

ashwanthkumar commented 8 years ago

This is kinda sad, that Cluster doesn't seem to converge even after 60 seconds on SnapCI for Scalecube based membership. Not sure what's going wrong, and I'm not able to reproduce it locally either. For now I've disabled the IntegrationTest. Will look into it further.

codecov-io commented 8 years ago

Current coverage is 74.22% (diff: 80.89%)

Sunburst

No coverage report found for master at 0df596a.

Powered by Codecov. Last update 0df596a...c2cdddc

ashwanthkumar commented 8 years ago

Fixed the test issue for ScaleCube on SnapCI.

ashwanthkumar commented 8 years ago

@brewkode please give this a look but don't merge it yet, I'm trying to take a first stab at #20 as part of this.

ashwanthkumar commented 8 years ago

Timing of this Tweet! Wow!

https://twitter.com/kellabyte/status/784952690946080768

How do SWIM implementations that do consistent hashing with vnodes assign vnode partitions when there’s no master or consensus?

ashwanthkumar commented 8 years ago

@brewkode I think we should merge this branch of take some features like extracting atomix out of the core and move back to JDK7, since most of our internal infra is still on JDK7. Especially the MR cluster.

ashwanthkumar commented 8 years ago

We might need a config file based Membership provider in the core.

ashwanthkumar commented 8 years ago

@brewkode Please start having a look at this when you've time.

cc: @gsriram7

ashwanthkumar commented 8 years ago

Merging this in. Will continue to work on the feedback through another PR.