tdspora / syngen

Open-source version of the TDspora synthetic data generation algorithm.
https://tdspora.ai/
GNU General Public License v3.0
17 stars 4 forks source link

The missing metadata in 'model_dataset.pkl' #349

Closed Anna050689 closed 5 months ago

Anna050689 commented 5 months ago

Issue: The _'modeldataset.pkl' file lacks associated metadata information.

Reasoning: Maintaining the relationships between referenced tables is crucial, and this can potentially be facilitated by metadata stored in the _'modeldataset.pkl' file.

Resolution: Implement a process that allows for the sensitive information in the metadata to be cleaned up before storing it in the _'modeldataset.pkl' file. This approach ensures the necessary metadata are maintained without compromising user privacy or data security.

Anna050689 commented 5 months ago

The changes related to this enhancement have been provided in syngen==0.5.10