Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/hadoop/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Sql 失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码2(状态=08S01,代码=2)_Sql_Hadoop_Hive_Mapreduce - Fatal编程技术网

Sql 失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码2(状态=08S01,代码=2)

Sql 失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码2(状态=08S01,代码=2),sql,hadoop,hive,mapreduce,Sql,Hadoop,Hive,Mapreduce,我无法在配置单元中使用SQL计数查询,出现以下错误 hive> select count(*) from test; Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH... WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execut

我无法在配置单元中使用SQL计数查询,出现以下错误

hive> select count(*) from test;

Usage: hadoop fs [generic options] -chgrp [-R] GROUP PATH...
WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = Dayanand Baligar_20191219014045_15170c53-6a45-45f3-a857-52a10837bd3a
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapreduce.job.reduces=<number>
Job running in-process (local Hadoop)
2019-12-19 01:40:48,560 Stage-1 map = 100%,  reduce = 0%
Ended Job = job_local2087281605_0002 with errors
01:40:48.563 [HiveServer2-Background-Pool: Thread-85] ERROR org.apache.hadoop.hive.ql.exec.Task - Ended Job = job_local2087281605_0002 with errors
Error during job, obtaining debugging information...
01:40:48.568 [Thread-73] ERROR org.apache.hadoop.hive.ql.exec.Task - Error during job, obtaining debugging information...
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
01:40:48.581 [HiveServer2-Background-Pool: Thread-85] ERROR org.apache.hadoop.hive.ql.Driver - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-1:  HDFS Read: 80 HDFS Write: 75 FAIL
Total MapReduce CPU Time Spent: 0 msec
01:40:48.594 [HiveServer2-Background-Pool: Thread-85] ERROR org.apache.hive.service.cli.operation.Operation - Error running hive query:
org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
        at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:387) ~[hive-service-2.1.0.jar:2.1.0]
        at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:237) ~[hive-service-2.1.0.jar:2.1.0]
        at org.apache.hive.service.cli.operation.SQLOperation.access$300(SQLOperation.java:90) ~[hive-service-2.1.0.jar:2.1.0]
        at org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:299) [hive-service-2.1.0.jar:2.1.0]
        at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_221]
        at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_221]
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1889) [hadoop-common-2.9.1.jar:?]
        at org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:312) [hive-service-2.1.0.jar:2.1.0]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_221]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_221]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_221]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_221]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]
WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
01:40:48.563 [HiveServer2-Background-Pool: Thread-85] ERROR org.apache.hadoop.hive.ql.exec.Task - Ended Job = job_local2087281605_0002 with errors
01:40:48.581 [HiveServer2-Background-Pool: Thread-85] ERROR org.apache.hadoop.hive.ql.Driver - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask (state=08S01,code=2)
hive>
hive>从测试中选择count(*);
用法:hadoop fs[通用选项]-chgrp[-R]组路径。。。
警告:MR上的配置单元在配置单元2中已弃用,在未来版本中可能不可用。考虑使用不同的执行引擎(即SCAPLE、TEZ)或使用HIVE 1 .x版本。
查询ID=Dayanand Baligar_2019121901405_15170c53-6a45-45f3-a857-52a10837bd3a
职位总数=1
正在启动作业1/1
编译时确定的reduce任务数:1
要更改减速器的平均负载(以字节为单位):
设置hive.exec.reducers.bytes.per.reducer=
为了限制减速器的最大数量:
设置hive.exec.reducers.max=
为了设置恒定数量的减速器:
设置mapreduce.job.reduces=
进程内运行的作业(本地Hadoop)
2019-12-19 01:40:48560第一阶段地图=100%,减少=0%
结束作业=Job_local2087281605_0002,有错误
01:40:48.563[HiveServer2后台池:Thread-85]错误org.apache.hadoop.hive.ql.exec.Task-结束作业=Job_local2087281605_0002,出现错误
作业期间出错,正在获取调试信息。。。
01:40:48.568[Thread-73]ERROR org.apache.hadoop.hive.ql.exec.Task-作业期间出错,正在获取调试信息。。。
失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码2
01:40:48.581[HiveServer2后台池:线程-85]错误org.apache.hadoop.hive.ql.Driver-失败:执行错误,返回代码2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
推出MapReduce作业:
第1阶段:HDFS读取:80 HDFS写入:75失败
花费的MapReduce CPU总时间:0毫秒
01:40:48.594[HiveServer2后台池:线程-85]错误org.apache.hive.service.cli.operation.operation-运行配置单元查询时出错:
org.apache.hive.service.cli.HiveSQLException:处理语句时出错:失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码2
在org.apache.hive.service.cli.operation.operation.toSQLException(operation.java:387)~[hive-service-2.1.0.jar:2.1.0]
在org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:237)~[hive-service-2.1.0.jar:2.1.0]
在org.apache.hive.service.cli.operation.SQLOperation.access$300(SQLOperation.java:90)~[hive-service-2.1.0.jar:2.1.0]
在org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:299)[hive-service-2.1.0.jar:2.1.0]
在java.security.AccessController.doPrivileged(本机方法)~[?:1.8.0_221]
在javax.security.auth.Subject.doAs(Subject.java:422)[?:1.8.0_221]
在org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1889)[hadoop-common-2.9.1.jar:?]
在org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:312)[hive-service-2.1.0.jar:2.1.0]
在java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)[?:1.8.0_221]
在java.util.concurrent.FutureTask.run(FutureTask.java:266)[?:1.8.0_221]
位于java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)[?:1.8.0_221]
在java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)[?:1.8.0_221]
在java.lang.Thread.run(Thread.java:748)[?:1.8.0_221]
警告:MR上的配置单元在配置单元2中已弃用,在未来版本中可能不可用。考虑使用不同的执行引擎(即SCAPLE、TEZ)或使用HIVE 1 .x版本。
01:40:48.563[HiveServer2后台池:Thread-85]错误org.apache.hadoop.hive.ql.exec.Task-结束作业=Job_local2087281605_0002,出现错误
01:40:48.581[HiveServer2后台池:线程-85]错误org.apache.hadoop.hive.ql.Driver-失败:执行错误,返回代码2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
错误:处理语句时出错:失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码2(state=08S01,code=2)
蜂巢>

您可能会发现此处接受的答案很有用:请提供更多信息