Spring Hadoop示例Mapreduce抛出auxService:Mapreduce_shuffle异常
在尝试在mapReduce项目下运行spring hadoop示例之后,我正在关注这些示例:Spring Hadoop示例Mapreduce抛出auxService:Mapreduce_shuffle异常,spring,hadoop,spring-data-hadoop,Spring,Hadoop,Spring Data Hadoop,在尝试在mapReduce项目下运行spring hadoop示例之后,我正在关注这些示例: $ mvn clean package $ sh ./target/appassembler/bin/wordcount 我得到了这个错误: 17:42:55,067 INFO doop.yarn.client.api.impl.YarnClientImpl: 174 - Submitted application application_1433091289740_0003 to Resourc
$ mvn clean package
$ sh ./target/appassembler/bin/wordcount
我得到了这个错误:
17:42:55,067 INFO doop.yarn.client.api.impl.YarnClientImpl: 174 - Submitted application application_1433091289740_0003 to ResourceManager at localhost/127.0.0.1:8032
17:42:55,095 INFO org.apache.hadoop.mapreduce.Job:1272 - The url to track the job: http://http://SJCC02MT0NUFD58.local:8088/proxy/application_1433091289740_0003/
17:42:55,096 INFO org.apache.hadoop.mapreduce.Job:1317 - Running job: job_1433091289740_0003
17:43:15,269 INFO org.apache.hadoop.mapreduce.Job:1338 - Job job_1433091289740_0003 running in uber mode : false
17:43:15,271 INFO org.apache.hadoop.mapreduce.Job:1345 - map 0% reduce 0%
17:43:16,306 INFO org.apache.hadoop.mapreduce.Job:1424 - Task Id : attempt_1433091289740_0003_m_000000_0, Status : FAILED
Container launch failed for container_1433091289740_0003_01_000002 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
我可以运行hadoop命令,例如:hdfs-ls、hdfs-dfs-put….,
我还可以访问:http://localhost:50070/dfshealth.html#tab-数据节点
但是为什么会发生这种异常呢?请确保您在warn-site.xml上有以下内容
<property>
<name>yarn.resourcemanager.hostname</name>
<value>0.0.0.0</value>
</property>
warn.resourcemanager.hostname
0.0.0.0