Open rc452860 opened 2 years ago
I think this issue about hadoop version. but I don't know how to fix it.
hello~~
Du kann von tpcds-gen/*/lib alle Files zu tpch-gen copy. Natürlich , musst du "lib/dsdgen.jar" nicht abdecken.
Can somebody please help with this error message ? I have tried making changes to the POM.XML file with the currently used hadoop version , exported the environment variables, still no help
Hi @rc452860, I also met this error, and I used this repo on the apache Hadoop whose version is 3.2.1.
As following is my solution.
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
<version>2.4.0</version>
<scope>compile</scope>
</dependency>
to
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
<version>3.2.1</version>
<scope>compile</scope>
</dependency>
3.2.1 is Hadoop version of my cluster
replace the useless hive parameters in settings/*.sql
set hive.optimize.sort.dynamic.partition.threshold=0;
to
set hive.optimize.sort.dynamic.partition=true;
execute the commands.
git clone https://github.com/hortonworks/hive-testbench.git
cd hive-testbench/
./tpch-build.sh
./tpch-setup.sh 2
everything is ok.
I using
tpch-setup.sh
in CDH6.3.2 the environment variable below :the output: