search

eremetic-framework / eremetic

A Framework for Mesos to run one-off tasks in docker
Other
149 stars 35 forks source link

PostgreSQL or MySQL backend #201

Open barryw opened 6 years ago

barryw commented 6 years ago

We're having a lot of problems with the ZK backend where Eremetic loses the connection to ZK and we lose tasks (they wind up stuck in QUEUED). I know that the underlying Go ZK library has issues around reconnecting (https://github.com/samuel/go-zookeeper/issues/133).

How hard would it be to add a relational backend to Eremetic? We looked at Bolt, but it only allows a single process to write to the database file. Ideally, we'd like to run several Eremetic containers, all connected to a single backend for high availability.

Does this interest anybody else? If it's not too hard, I might even be able to sell some cupcakes to raise some bounty money. Any takers?

amanelis commented 6 years ago

obviously I 👍 this one as well

keis commented 6 years ago

There already is an option to use bolt as the backing for the db making it local to the container. Adding another db should not be terribly hard.

This would not automatically let you run in n HA setup and that would need more work within the scheduler bit of eremetic.