Seeking to make the following changes to the config format:
Add JSON5 compatibility to allow comments within the config file
Convert most of the top level keys to children of 4 or 5 top level categories (e.g.: General, Model params, Optimizer, Dataloader, ...)
Allow each model to have its own set of default parameters. This should make it easier for users to try different models for the first time, as they would only need to specify the architecture's name and would not need to find sample configs detailing the range of reasonable values for each parameter.
Seeking to make the following changes to the config format:
Merge deadline: Fri 2023-06-09