I just installed hadoop 3.3.6 and hive 4.0.0 with mysql as metastore. when running create table or select * from… it runs well. But when I try to do insert or select join, hive always fails. I’m noticing that hive fails at the mapreduce task and “requires lock = true” even though I didn’t create any lock.
I already gave chmod 777
permission to the warehouse directory in hdfs but it didn’t solve my problem.
yarn doesn’t give log when using MR execution Engine
Here’s the log that I get from hive.log
:
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
No Stats for default@student1, Columns: name, gpa, age
No Stats for default@student2, Columns: nama, jurusan, hobi
Query ID = hadoop_20240923190426_36da4532-a25c-4d21-b7ec-47f18290f3dd
Total jobs = 1
java.lang.NullPointerException at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:843)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:458)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:475)
at org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask.initialize(MapredLocalTask.java:136)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:766)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Execution failed with exit status: 1
Obtaining error information
Task failed!
Task ID:
Stage-4
Logs:
/tmp/hadoop/hive.log
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
Sorry for my bad English and wrong use of tool in this forum. It’s my first time asking here.
Dzaki Wicaksono is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
1