Add a new config key to allow skipping the dirs validation during configuration phase
Todos
[ ] Tests
[ ] Documentation
[ ] Changelog
There is no reason to validate the dirs until we actually run the
extraction. This PR adds the validate_dir option which defaults to
true so users can opt for not validating the dirs paths during
configuration warmup phase.
It's possible that we still want to do validation at extract phase
and we can add the code to do that if it is necessary.
Description
Add a new config key to allow skipping the dirs validation during configuration phase
Todos
There is no reason to validate the dirs until we actually run the extraction. This PR adds the validate_dir option which defaults to
true
so users can opt for not validating the dirs paths during configuration warmup phase.It's possible that we still want to do validation at extract phase and we can add the code to do that if it is necessary.