search

Netflix / dynomite-manager

A sidecar to manage Dynomite clusters
https://github.com/Netflix/dynomite
Apache License 2.0
91 stars 59 forks source link

Run Dynomite-manager locally #52

Closed patademahesh closed 6 years ago

patademahesh commented 8 years ago

Is there any way to run dynomite-manager without AWS? As we have our own Data Center.

ipapapa commented 8 years ago

Yes you can run it locally. There is some development effort, i.e. you probably need to implement some interfaces.

For example the InstanceDataRetriever, IMembership, and ICredential. The instance the InjectedWebListener you can bind your implementation of these interfaces. If you plan to go through this way please feel free to file PRs as others maybe interested.

ipapapa commented 7 years ago

@patademahesh I am closing this issue as it was a question and has been inactive for more than 15 days.

bgabler commented 7 years ago

@patademahesh were you able to get this running local? We're trying to use dynomite-manager with google cloud and obviously running into the same issues.

ipapapa commented 7 years ago

I am doing a major refactoring that will simplify a lot of the interfaces so as to be able to run across platforms easier, and yes it can be run locally. @bgabler What is your time frame?

bgabler commented 7 years ago

@ipapapa just sent you an email. Thanks!

namita13 commented 7 years ago

We have a similar setup, using our own data centers. Is there any example available for local setup?

ipapapa commented 7 years ago

We do not currently have the interfaces implemented for local data centers or anything outside of AWS. The work to run on ECS has also been done by some OSS folks. However, the new DM which I am yet to publish (have been lazy about it) will run locally because it will have a main() class.

namita13 commented 7 years ago

When do you expect to publish the new version? It would be great if we can get it running locally.

ipapapa commented 7 years ago

@namita13 sorry, I missed this. I am 70% done with the changes. I will shortly start doing PRs from tomorrow. It may take a week or so.

gobijagan commented 7 years ago

Is that changes done? Bcoz i'm also having the same question.

ipapapa commented 7 years ago

@gobijagan yes

imlit commented 7 years ago

Hi, do you have any updated instructions on how to run it without AWS? Thanks

ipapapa commented 7 years ago

@imlit I would love to see others contributing to this effort. I have done a lot of work in abstracting the pieces for anybody to try helping out.

ipapapa commented 6 years ago

I think this has been addressed overall. I would love to see any further issues from the community.

nginxsantos commented 6 years ago

@ipapapa , Has this been done and delivered? Can you please guide me what are things need to be done for local deployment.? thanks, santos

Poly1199 commented 5 years ago

Hi, has this already done ? I can not find any guide for local deployment, if something exist its can be very helpful for me, Thanks, Tomas

ipapapa commented 5 years ago

I am trying to understand why do you need to run Dynomite-manager locally? The point of Dynomite-Manager is to provide all these functionalities to manage a cluster (many instances). If you are just running Dynomite, you can spin it up without the need of a sidecar.

I think the work that I did the past would enable to bootstrap DM locally for testing but I did not completely test it. There was some other work in the following issue.

Finally, all the work to abstract the reusable parts has been completed. Adding support for different environments (other than AWS) should be fairly straight forward, but if something is blocking you (in the sense that it is not abstracted properly), please let me know and I can help.

Poly1199 commented 5 years ago

i have offline servers so i can not use AWS this is reason why i want to use it localy

Kevzz81517 commented 4 years ago

@ipapapa I am trying to run DM on my local stack for PoC purpose. I can't get it up. Can you list items to be implemented in doing it ?Thanks !

nabajyoti123 commented 4 years ago

@namita13 are able to run dynomite Manager without AWS ?

nabajyoti123 commented 4 years ago

@ipapapa im trying to run dynomite manager without AWS . how do i do it ? can i find example some where?

abhinav0101 commented 3 years ago

+1 to running dynomite manager without AWS in private datacenters

ipapapa commented 3 years ago

I do not believe there are any instructions that ever wrote about running outside of AWS. As I mentioned above, most of the work in terms of development and abstracting interfaces has been done. There might be a few more to be done in case I missed something. We would love someone from the OSS community to pick up this effort and develop instructions and documentation. A stunning example is @diegopacheco who created similar instructions to run on AWS and we published them on the Wiki.

abhinav0101 commented 3 years ago

@ipapapa Thank You for responding quickly. If we create a work-around for the cold bootstrap feature and the health discovery feature for a 4 node Dynomite cluster (DC =1 , RF =4), what else do you think are absolute essentials that we will be missing from dynomite manager. All we care about is that there shouldnt be any single point of failure in our system and down time should be close to zero for single node failure

Currently, we have tested our 4 node set up successfully by hardcoding the TokenMapSupplier and the Config provided to dynoclient also remains static/unchanged

Incorporating dynomite manager directly is also on our list and we will be exploring that soon.

guru1306 commented 3 years ago

@abhinav0101 Were you able to implement this configuration without Dynomite manager? Is it running successfully? Can you share the steps?

diegopacheco commented 3 years ago

@guru1306 this might give you some ideas https://github.com/diegopacheco/dynomite-docker

abhinav0101 commented 3 years ago

Yes, Dynomite is running for our production setup for about 3 months now. We haven't introduced the Dynomite manager yet. Thanks, Diego for putting this link-up, will read about this.