search

tehbenneh / ubuntu_mfschunkserver

1 stars 0 forks source link

A very telling Dockerfile #1

Open faddat opened 8 years ago

faddat commented 8 years ago

So, What are you working on.....?

faddat commented 8 years ago

....also-- why MooseFS instead of LizardFS?

tehbenneh commented 8 years ago

Hi Jacob, thanks for contacting me - think you're the first person I've heard from on GitHub!

I'm slowly piecing together a docker-based MooseFS implementation; primarily for my own use (at home and workplace) but if it proves easy enough to deploy and manage then I'd love for people to give it a go themselves.

As for lack of lizardFS, it's mostly because I know moose pretty well at this point and I'm quite happy with how goals/tiering work in the 3.0 branch, is lizardFS mirroring that these days? I've not had a huge amount of time to check it out lately!

The idea/project has been moved over to http://d-tank.github.io/core/ but is really only a placeholder until I get enough of it working for testing!

On 21 Feb 2016, at 13:52, Jacob Gadikian notifications@github.com wrote:

....also-- why MooseFS instead of LizardFS?

— Reply to this email directly or view it on GitHub.

faddat commented 8 years ago

Links to same, but in Lizardfs.

https://github.com/badri/lizardfs-client https://github.com/badri/lizardfs-master https://github.com/badri/lizardfs-shadow https://github.com/badri/lizardfs-chunk https://github.com/badri/lizardfs-cgiserver https://github.com/badri/lizardfs-metalogger

It's incredibly interesting to me that you chose old computers. Ours is a P2P cloud running atop (WIP notice) Phones, desktops, laptops, and of course, servers. The overall goal is to simultaneously be global and hyperlocal.

I didn't know the answer to your question about Lizardfs, so I asked them: https://github.com/lizardfs/lizardfs/issues/388

I am also curious if you have in the past gone multidatacenter with this stuff. Since we are aiming at a global deployment, I'm curious how latency works out-- and about scale, too. I know it's "n-nodes" but I haven't really ever seen a genuine N-nodes product, you know? Our plans call for >200 storage sites scattered all around. I'm going to finish up this deploy with the Lizard and then I'll check out the Moose, I think.

tehbenneh commented 8 years ago

faddat, thanks for linkage. I'll definitely give lizard a look-in when I get time, however my priority right now is getting to a testable state with all of my components! thanks for asking the lizardsfs peeps, i'm interested to find out too.

you mention it's interesting that i've chosen old computers, how do you mean? could you give me some more information on your own project?

I've only gone multi-dc in the sense of using multiple server rooms across the same site, linked via fibre, and it's used day-to-day with no problems. In theory, there shouldn't be any problems with going multi-datacentre, and latency would really hinge on the IO you're expecting in your workloads and how you're replicating between the datacenters. I believe Moose fuse client will choose chunkserver with lowest latency in cases where same data is available from different nodes - but i wouldn't quote me on that just yet. In recent updates I believe there's been some options added geared towards favouring certain labels of chunkserver, but i've not had enough time to check that out fully either!

sorry if i can't answer all of your questions, this project is mostly a learning exercise for myself with the potential to be something useful to other people further down the line. Still, definitely interested in hearing more about your own project!

tehbenneh commented 8 years ago

ps, this page [and associated dockerhub page] is deprecated now in favour of the following;

https://github.com/d-tank

it's likely that i'll start developing it on top of fedora soon as i'm moving from ubuntu->fedora, but the functionality will be the same. images are already pullable but need runtime config if you want to try them out :)

https://hub.docker.com/u/dtank/

faddat commented 8 years ago

Why moving from Ubuntu to Fedora? I really like ubu16.04..... On Feb 22, 2016 3:35 AM, "Ben Harker" notifications@github.com wrote:

ps, this page [and associated dockerhub page] is deprecated now in favour of the following;

https://github.com/d-tank http://url

it's likely that i'll start developing it on top of fedora soon as i'm moving from ubuntu->fedora, but the functionality will be the same. images are already pullable but need runtime config if you want to try them out :)

https://hub.docker.com/u/dtank/ http://url

— Reply to this email directly or view it on GitHub https://github.com/tehbenneh/ubuntu_mfschunkserver/issues/1#issuecomment-186909406 .