databricks / spark-sql-perf

Apache License 2.0
582 stars 406 forks source link

Fix output from dbgen #197

Open lvaz opened 3 years ago

lvaz commented 3 years ago

TPC-H related data could not be generated because dbgen writes to a file and not to stdout, as opposed to dsdgen. This patch dumps each table content and removes the generated file. Removing generated files is necessary, otherwise data generation hangs if the table already exists.