search

gregrahn / tpcds-kit

TPC-DS benchmark kit with some modifications/fixes
317 stars 200 forks source link

[dsdgen][Adding Flag] Allowing schema generation... #53

Closed fartzy closed 3 years ago

fartzy commented 3 years ago

Schemas can also be created with the schemas flag. The only schema type that has been tested is for Spark. The JSON is not a valid JSON as of now and it is in the form below where you can see there needs to be schema added to the json document. 


{
    "name": "store_returns",
    "columns": {
        "sr_returned_date_sk": "STRING",
        "sr_return_time_sk": "STRING",
        "sr_item_sk": "STRING",
        "sr_customer_sk": "STRING",
        "sr_cdemo_sk": "STRING",
        "sr_hdemo_sk": "STRING",
        "sr_addr_sk": "STRING",
        "sr_store_sk": "STRING",
        "sr_reason_sk": "STRING",
        "sr_ticket_number": "STRING",
        "sr_return_quantity": "INT",
        "sr_return_amt": "DECIMAL (7,2)",
        "sr_return_tax": "DECIMAL (7,2)",
        "sr_return_amt_inc_tax": "DECIMAL (7,2)",
        "sr_fee": "DECIMAL (7,2)",
        "sr_return_ship_cost": "DECIMAL (7,2)",
        "sr_refunded_cash": "DECIMAL (7,2)",
        "sr_reversed_charge": "DECIMAL (7,2)",
        "sr_store_credit": "DECIMAL (7,2)",
        "sr_net_loss": "DECIMAL (7,2)",
    }
}