hortonworks / hive-testbench

374 stars 283 forks source link

./tpcds-setup.sh 2 fails #36

Open herrytco opened 3 years ago

herrytco commented 3 years ago

Hello, I am running:

and I am trying to generate testdata.

I did:

./tpcds-build.sh
./tpcds-setup.sh 2

the latter fails then with this message:

[...]
TPC-DS text data generation complete.
Loading text data into external tables.
0: jdbc:hive2://localhost:2181/ (closed)> create database if not exists ${DB};

make: *** [load_orc_2.mk:3: date_dim] Error 2
Loading constraints
0: jdbc:hive2://localhost:2181/ (closed)> -- set hivevar:DB=tpcds_bin_partitioned_orc_10000
0: jdbc:hive2://localhost:2181/ (closed)>
0: jdbc:hive2://localhost:2181/ (closed)> alter table customer_address add constraint ${DB}_pk_ca primary key (ca_address_sk) disable novalidate rely;

Data loaded into database tpcds_bin_partitioned_orc_2.

But when I check, the database does not exist. How can I resolve this issue?

Aristohack commented 2 years ago

Thanks, I have also encountered this problem. Have you solved it?

frsv commented 1 year ago

For future generations: scripts in these repo connect to remote Hive via 2181 port, but it's non-conventional. The default port is 10000, see link 1 and link 2.

Change https://github.com/hortonworks/hive-testbench/blob/hdp3/tpcds-setup.sh#L73 to:

- HIVE="beeline -n hive -u 'jdbc:hive2://localhost:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2?tez.queue.name=default' "
+ HIVE="beeline -n hive -u 'jdbc:hive2://localhost:10000/' "

I believe it duplicates #35