Interest in a local/dev mode for small jobs or development

stitchfix / flotilla-os

Open source Flotilla

Apache License 2.0

192 stars 10 forks source link

Interest in a local/dev mode for small jobs or development #82

Open thenomemac opened 6 years ago

thenomemac commented 6 years ago

Not sure if an issue is the right place to discuss this but... I'm thinking about forking this project and adding a local mode that devs could use to test flottila or you could use on prem if you're team has a huge vm. My vision for local mode if the following:

Don't over opitimize for reliability, use AWS for that use case, these are batch jobs. If it crashes then hopefully you had a scheduler or Cron thatll know to retry again when the go process is back up
minimize dependencies backing the AWS services into simple golang in process equivalents.
use local disk for storage.
use local docker deamon for execution.
support some form of artificial resource limiting to prevent local machine from becoming over provisioned.

Does this sound interesting to anyone else's use case? Interested to get others thoughts on this.

alienrobotwizard commented 6 years ago

Yes - this local mode could be local execution engine, local queue manager, etc; happy to discuss

thenomemac commented 6 years ago

Started working on this yesterday but I'm a golang noob so some of the implementation was more involved than I thought at first. Anyways. I'll probably work on this more time permitting. Very interested in this project.

2morales commented 5 years ago

Hello,

Updates on this? It would be a really useful feature for people having their own infrastructure.

Thank you

thenomemac commented 5 years ago

I have not had time to work on this.

On Fri, Mar 29, 2019, 6:12 AM João Morais notifications@github.com wrote:

Hello,

Updates on this? It would be a really useful feature for people having their own infrastructure.

Thank you

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/stitchfix/flotilla-os/issues/82#issuecomment-477943519, or mute the thread https://github.com/notifications/unsubscribe-auth/AOeuWmBZhwfTFLaTWTwry6M21HOywr2Lks5vbecSgaJpZM4TVSEe .

2morales commented 5 years ago

Okay, thank you!

I have not had time to work on this. … On Fri, Mar 29, 2019, 6:12 AM João Morais @.***> wrote: Hello, Updates on this? It would be a really useful feature for people having their own infrastructure. Thank you — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#82 (comment)>, or mute the thread https://github.com/notifications/unsubscribe-auth/AOeuWmBZhwfTFLaTWTwry6M21HOywr2Lks5vbecSgaJpZM4TVSEe .