SynthVAE Version 2

[DaveBrind-zz]

Additions

• GMM Pre-Processing Fix
• Hyperparameter Tuning
• Loss visualisation & saving
• Support for internal MIMIC sets
• Notebook implementation for hyperparameter tuning & Investigations

Still To Be Done

• Clean up documentation files (requirements.txt to new library versions) - Requirments.txt is now complete with updated versioning
• Clean up & check the old codes sdv_baselines.py, scratch_vae_expts.py - All code has been formatted using black and Dom's old codes have been updated
• Bring in documentation showing how to get GPU support - GPU support section is now in the readme
• Update Changelog.md - Still need to update

Notable File Changes

• Brought in RDT but only change two sections of code within the transformers folder -> numerical.py -> random_state added in init function line 582, this is then used as argument at line 626 when defining GMM model
• Folders investigations & Hyperparameter Tuning just contain code for training the model (with or without dp) as well as plot and calculate statistical & privacy metrics
• sdv_baselines, scratch_vae_expts have had parse args updated with new features
• Both Opacus & RDT have been reformatted using black so a lot of line changes will be due to this

[JRPearson500]

Could you add a link to MIMIC notebook for the "follows the data guidance provided in the Github repository"

[danjscho]

Thanks for the changes so far - can you make all the filenames have no spaces as well, for the same reasons as discussed (replacement with underscores is fine). e.g. Hyperparameter_Tuning/Hyperparameter Tuning MIMIC.py -> Hyperparameter_Tuning/Hyperparameter_Tuning_MIMIC.py