InGen is a command line tool written on top of pandas and great_expectations to perform small scale data transformations and validations without writing code.
Describe the bug
InGen reads a property file which contains key value pairs separated by an equal to (=) sign. The class properties.py (ingen/utils/properties.py) is responsible for reading the file from a location which is defined by the OS environment variable config_path. If the file is not present the program exits with a FileNotFoundError. Also close the file after reading it.
To Reproduce
Steps to reproduce the behavior:
Set the environment variable config_path
Do not create a config.properties file
Run InGen with any valid yaml file
Program ends with FileNotFoundError
Expected behavior
The program should handle this gracefully and throw a helpful error message and how the users can correct it.
Environment
Operating System: MacOS (Should affect other OSs too)
Great Expectations Version: N/A
Additional context
A feature can be added to allow users to pass the full path of a config file as a command line argument.
Describe the bug InGen reads a property file which contains key value pairs separated by an equal to (=) sign. The class
properties.py(ingen/utils/properties.py) is responsible for reading the file from a location which is defined by the OS environment variableconfig_path. If the file is not present the program exits with a FileNotFoundError. Also close the file after reading it.To Reproduce Steps to reproduce the behavior:
config_pathconfig.propertiesfileExpected behavior The program should handle this gracefully and throw a helpful error message and how the users can correct it.
Environment
Additional context A feature can be added to allow users to pass the full path of a config file as a command line argument.