search

opendp / smartnoise-sdk

Tools and service for differentially private processing of tabular and relational data
MIT License
254 stars 69 forks source link

Move Transforms to Separate Package #554

Open joshua-oss opened 1 year ago

joshua-oss commented 1 year ago

Transforms are now capable of generating metadata, which introduces a dependency between smartnoise-sql and smartnoise-synth. These packages should be able to be independently installed. A possible solution is to move transforms to a separate package and move metadata into the transforms package. Then each of the larger packages could include transforms as a dependency.

Splitting this off would be a breaking change for smartnoise-synth, because namespaces would change. It need not be a breaking change for smartnoise-sql.

joshua-oss commented 1 year ago

Could ideally move the Metadata class at the same time, to make it easier to infer metadata from data, and instantiate transformers from Metadata. This would then also be a breaking change for smartnoise-sql.