Open galaxy79 opened 1 year ago
Hi
The way to specify how the data is generated for nested structures is to create temporary fields and generate the values for them and then combine the generated fields into the desired structure. You cant refer to a nested field in the data generation rules at present.
See the following documentation page for more information: https://databrickslabs.github.io/dbldatagen/public_docs/generating_json_data.html#generating-complex-column-data
I'll update the documentation to provide some clearer examples when creating the data using an existing schema
Expected Behavior
I have a nested schema for the data set and want to set the value template patterns for the attributes bankAcctId,bankProduct,bankProduct,storeGroup,association,merchantId,terminalId using
withColumnSpec
to generate the synthetic data.I tried the below code snippet to build the synthetic data
The code execution was failed with error
I looking for some direction or example on how to use it.
Your Environment
Running it on mac m1 pro ( macOS venture 13.5)
dbldatagen
version used:0.3.5