Hadoop 为什么当我运行配置单元选择时,应用程序会立即从提交更改为失败?

Hadoop 为什么当我运行配置单元选择时,应用程序会立即从提交更改为失败?,hadoop,hive,hiveql,Hadoop,Hive,Hiveql,我刚刚从t1运行了SELECT COUNT* 然后它失败了,WEB中应用程序的最终状态被终止 配置单元日志如下所示: 2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1415104634062_0005 2014-11-04 23:06:45,264 INFO org.apach

我刚刚从t1运行了SELECT COUNT*

然后它失败了,WEB中应用程序的最终状态被终止

配置单元日志如下所示:

2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1415104634062_0005  
2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root IP=10.20.216.51 OPERATION=Submit Application Request    TARGET=ClientRMService  RESULT=SUCCESS  APPID=application_1415104634062_0005    
2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1415104634062_0005 State change from NEW to NEW_SAVING    
2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1415104634062_0005    
2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1415104634062_0005 State change from NEW_SAVING to SUBMITTED    
2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1415104634062_0005 with final state: FAILED    
2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1415104634062_0005 State change from SUBMITTED to FINAL_SAVING    
2014-11-04 23:06:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1415104634062_0005    
2014-11-04 23:06:45,265 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1415104634062_0005 State change from FINAL_SAVING to FAILED    
2014-11-04 23:06:45,265 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Couldn't find application application_1415104634062_0005    
2014-11-04 23:06:45,265 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE  DESCRIPTION=App failed with state: FAILED   PERMISSIONS=Application application_1415104634062_0005 submitted by user root to unknown queue: default APPID=application_1415104634062_0005    
2014-11-04 23:06:45,265 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1415104634062_0005,name=select count(*) from tt3(Stage-1),user=root,queue=default,state=FAILED,trackingUrl=N/A,appMasterHost=N/A,startTime=1415113605263,finishTime=1415113605264,finalStatus=FAILED

我知道了,我在mapred-site.xml中设置了mapreduce.map.memory.mb,大于warn.scheduler。最大分配mb。

取决于您的ram大小 像这样设置配置

在java-site.xml中 这是总的群集内存

<name>yarn.nodemanager.resource.memory-mb</name>
<value>40960</value>

<name>yarn.scheduler.minimum-allocation-mb</name>
<value>2048</value>
在MapReduce中 设置变量mapred-site.xml:

<name>mapreduce.map.memory.mb</name>
<value>4096</value>
<name>mapreduce.reduce.memory.mb</name>
<value>8192</value>