leo-project / leofs

The LeoFS Storage System
https://leo-project.net/leofs/
Apache License 2.0
1.55k stars 155 forks source link

[MDC-Replication] Implement communication with three and over clusters #338

Open yosukehara opened 9 years ago

yosukehara commented 9 years ago

Actually, we does not support communication with three and over clusters w/LeoFS v1.2. So we're planning to implement that with LeoFS v1.4.

tld commented 9 years ago

There are some significant use-cases that depend on this. A typical replication scenario would often include one operational datacenter in the US, one or two in EMEA, and also a "home node", such as in a companys own datacenter. The latter bing suitable for backup and local access, but not for serving to the world at large. This 3-datacenter approach seems to be fairly typical and desirable to a lot of people, but is as of yet unsupported.

Not trying to complain, I'm very grateful for the work being done on LeoFS, just mentioning that some (obviously myself included) view this as a major feature, and possibly requirement before adopting LeoFS.

yosukehara commented 9 years ago

Thank you for your comment. We will consider that we put a high priority on implementing this feature.

yosukehara commented 9 years ago

We have decided we implement the triple cluster replication feature with LeoFS v1.4.0-pre3.

tld commented 9 years ago

This is extremely appreciated, thank you very much!

casibbald commented 8 years ago

How stable is the tripple cluster functionality now? I am really keen on this for a solution I am proposing however we have 5DC's with 20 nodes per DC.

yosukehara commented 8 years ago

Actually, it's behind schedule to deliver this feature. We're planning to release it with v1.4.0.

asphytotalxtc commented 6 years ago

Just to chime in here, we too would be really interested in this functionality (we have three DCs). Is it still planned for a 2.0.0 release?

mocchira commented 6 years ago

@asphytotalxtc Sorry for the late reply. Yes it's planned for a 2.0 release line. @yosukehara will explain the detailed plan sooner or later.

yosukehara commented 6 years ago

@asphytotalxtc We need to implement a new consensus mechanism as leo_konsul to deliver the more scalable, reliable and efficient storage system - LeoFS v2 then will start developing the new MDC replication feature, which includes multi-cluster/ multi-datacenter replication.

asphytotalxtc commented 6 years ago

Good to see it's still planned, thanks for the update guys! :)