Hadoop 联系ResourceManager时出现错误的主机名

Hadoop 联系ResourceManager时出现错误的主机名,hadoop,yarn,hadoop2,Hadoop,Yarn,Hadoop2,我正在尝试在配置单元中编写一个简单的查询(只是一个插入),但在如何配置MapReduce作业方面遇到了问题。容器分配正确,但我的作业从未运行 看来他们联系资源经理的方式不对。我已经验证(通过JPS)我的ResourceManager确实在运行,并且运行在hostnamehadoop1.personal上,所有服务器都在/etc/hosts中引用该主机名。问题是这样的: 2016-09-27 09:41:55,223 INFO [main] org.apache.hadoop.ipc.CallQ

我正在尝试在配置单元中编写一个简单的查询(只是一个插入),但在如何配置MapReduce作业方面遇到了问题。容器分配正确,但我的作业从未运行

看来他们联系资源经理的方式不对。我已经验证(通过JPS)我的ResourceManager确实在运行,并且运行在hostname
hadoop1.personal
上,所有服务器都在/etc/hosts中引用该主机名。问题是这样的:

2016-09-27 09:41:55,223 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2016-09-27 09:41:55,224 INFO [Socket Reader #1 for port 45744] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 45744
2016-09-27 09:41:55,230 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2016-09-27 09:41:55,230 INFO [IPC Server listener on 45744] org.apache.hadoop.ipc.Server: IPC Server listener on 45744: starting
2016-09-27 09:41:55,299 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
2016-09-27 09:41:55,300 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
2016-09-27 09:41:55,300 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
2016-09-27 09:41:55,375 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8030
2016-09-27 09:41:56,414 INFO [main] org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2016-09-27 09:41:57,415 INFO [main] org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2016-09-27 09:41:58,415 INFO [main] org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2016-09-27 09:41:59,416 INFO [main] org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2016-09-27 09:42:00,417 INFO [main] org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
当然,在最终死亡之前,它确实会持续一段时间。 现在,我知道我的配置在某种意义上得到了提升。在日志的前面,容器显示
2016-09-27 09:41:52783 INFO[main]org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils:Default file system[hdfs://hadoop1.personal:8020]
哪一个是要使用的正确的
NameNode

此外,如果我转到NodeManager配置(即
http://hadoop2.personal:8042/conf
)然后我可以看到:

<property>
  <name>yarn.resourcemanager.hostname</name>
  <value>hadoop1.personal</value>
  <source>yarn-site.xml</source>
</property>
<property>
  <name>yarn.resourcemanager.scheduler.address</name>
  <value>${yarn.resourcemanager.hostname}:8030</value>
  <source>yarn-default.xml</source>
</property>

warn.resourcemanager.hostname
hadoop1.1
web-site.xml
warn.resourcemanager.scheduler.address
${spirn.resourcemanager.hostname}:8030
warn-default.xml
因此,
节点管理器
似乎确切地知道它需要在哪里

这对我来说似乎非常奇怪:NodeManager和ResourceManager在一起谈得很好,但容器却联系了错误的调度程序。如何控制容器联系以进行调度的地址

作为旁注,我已经按照中的建议在启用和不启用IPv6的情况下对此进行了测试。没有效果