search

hortonworks / hive-testbench

376 stars 283 forks source link

load-partitioned.sql doesn't inherit shell value for ${REDUCERS} #10

Open scorpiienator opened 5 years ago

scorpiienator commented 5 years ago

The intent for the tpch-setup.sh command is to pass the REDUCERS variable into the final stage, which checks the table creation in the line

hive -i settings/load-${SCHEMATYPE}.sql -f ddl-tpch/bin${SCHEMA_TYPE}/analyze.sql --database ${DATABASE};

But the $REDUCERS variable cannot be interpreted in load-partitioned.sql in the line

set hive.exec.reducers.max=${REDUCERS};

This results in a hive execution error