Validate config immediately instead of waiting for problems from downstream consumers

[markhenrick]

• When validation happens
• How the result is indicated (boolean, exception - what type?)