Closed gitava closed 4 years ago
run change as root hadoop user.
[vagrant@hdp-node-01 ~]$ hdfs dfs -chown vagrant:supergroup /tmp
chown: changing ownership of '/tmp': Permission denied. user=hive is not the owner of inode=/tmp
[vagrant@hdp-node-01 ~]$ export HADOOP_USER_NAME=root
[vagrant@hdp-node-01 ~]$ hdfs dfs -chown vagrant:supergroup /tmp
[vagrant@hdp-node-01 ~]$ hadoop hdfs -ls /
Error: Could not find or load main class hdfs
[vagrant@hdp-node-01 ~]$ hdfs dfs -ls /
Found 6 items
drwxr-xr-x - fllbeaver supergroup 0 2020-06-24 03:13 /input
drwxr-xr-x - fllbeaver supergroup 0 2020-06-24 03:33 /output
drwxr-xr-x - fllbeaver supergroup 0 2020-06-24 02:28 /temp
drwx------ - vagrant supergroup 0 2020-06-28 06:09 /tmp
drwxr-xr-x - vagrant supergroup 0 2020-06-28 06:40 /user
drwxr-xr-x - root supergroup 0 2020-05-27 12:31 /wordcount
[vagrant@hdp-node-01 ~]$ hdfs dfs -chmod 755 /tmp
[vagrant@hdp-node-01 ~]$ hdfs dfs -ls /
Found 6 items
drwxr-xr-x - fllbeaver supergroup 0 2020-06-24 03:13 /input
drwxr-xr-x - fllbeaver supergroup 0 2020-06-24 03:33 /output
drwxr-xr-x - fllbeaver supergroup 0 2020-06-24 02:28 /temp
drwxr-xr-x - vagrant supergroup 0 2020-06-28 06:09 /tmp
drwxr-xr-x - vagrant supergroup 0 2020-06-28 06:40 /user
drwxr-xr-x - root supergroup 0 2020-05-27 12:31 /wordcount
Issue solved.
hive> insert into htest values("xiaoxu","20");
WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. tez, spark) or using Hive 1.X releases.
Query ID = vagrant_20200628115827_9ac7ffe6-f4da-4c22-ba9c-2bd2922b78ef
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_1593342618576_0004, Tracking URL = http://hdp-node-01:8088/proxy/application_1593342618576_0004/
Kill Command = /home/vagrant/hadoop/bin/hadoop job -kill job_1593342618576_0004
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
2020-06-28 11:58:44,235 Stage-1 map = 0%, reduce = 0%
2020-06-28 11:59:44,618 Stage-1 map = 0%, reduce = 0%
2020-06-28 11:59:57,012 Stage-1 map = 100%, reduce = 0%
Ended Job = job_1593342618576_0004 with errors
Error during job, obtaining debugging information...
Examining task ID: task_1593342618576_0004_m_000000 (and more) from job job_1593342618576_0004
Task with the most failures(4):
-----
Task ID:
task_1593342618576_0004_m_000000
URL:
http://hdp-node-01:8088/taskdetails.jsp?jobid=job_1593342618576_0004&tipid=task_1593342618576_0004_m_000000
-----
Diagnostic Messages for this Task:
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-1: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec