Configuration loading should favor production as source of truth

[Raynos]

Currently we have

• common.json
• production.json
• production.{dc}.json

as an a deep extend inheritance tree. where production overwrites common.

It would be a lot easier to reason about our production dependencies if we had

• production.json
• production.{dc}.json

Where production.{dc}.json overwrites production.

To reduce duplication for development and local environments we can have

• production.json
• local.json

and

• production.json
• development.json

If you have any configurations that are different locally or in development you can turn them off either by changing the value or setting it to null.

This encourages people to treat production.json as the source of truth and to make their local and development environments be as close to production as possible.

To avoid doing NODE_ENV=local in tests, unit tests and when running your application locally we should default NODE_ENV to the string local if it's unset.

[jcorbin]

Big :+1: on this as it will force any prod vs dev differences to be explicit: don't want kafka logging on dev server, okay disable it, but your log file gets written same as prod, instead of using the horrible console -> supervisord -> /different/path/from/prod current status quo.

[rajeshsegu]

+1 Love the idea.

[sh1mmer]

+1 we should definitely do this but it will be potentially dangerous for roll it out so we should actively get people to upgrade when we release this.

[Raynos]

Bump the major or rename/rewrite the entire thing :D

[lxe]

:+1: