search

JDACS4C-IMPROVE / IMPROVE

Libraries and scripts for basic IMPROVE functionalities
MIT License
1 stars 3 forks source link

Save config in correct format #57

Open wilke opened 3 months ago

wilke commented 3 months ago

Config files are in ini format. Clean code and save as ini; there are two functions save_config and save_params_file

jonesse3 commented 1 month ago

@wilke Is the point to create a more readable params file? Currently the param_log_file.txt outputs this:

{'input_dir': '--help', 'output_dir': 'hidra_test_ml', 'log_level': 'WARNING', 'config_file': None, 'param_log_file': 'param_log_file.txt', 'data_format': '.csv', 'infer_batch': 64, 'model_file_name': 'model', 'model_file_format': '.h5', 'loss': 'mse', 'input_data_dir': 'hidra_test_ml', 'input_model_dir': 'hidra_test_ml', 'calc_infer_scores': True, 'metric_type': 'regression', 'y_col_name': 'auc'}

wilke commented 1 week ago

The goal is to have a function which dumps the config in use. This is important for reproducibility and provenance. The file should be in ini format since that is the format we chose for our config. This will allow to reproduce a run just by pointing to the exported config.