Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/hadoop/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Hadoop MR作业始终处于挂起状态_Hadoop - Fatal编程技术网

Hadoop MR作业始终处于挂起状态

Hadoop MR作业始终处于挂起状态,hadoop,Hadoop,我只需在hadoop 2.6.0上运行单词计数MapReduce作业share/hadoop/MapReduce/hadoop-MapReduce-examples-2.6.0.jar,我发现该作业已被接受,但始终处于挂起状态 我从非常基本的伪分布式配置开始Hadoop: <?xml version="1.0"?> <!-- core-site.xml --> <configuration> <property> <name>

我只需在hadoop 2.6.0上运行单词计数MapReduce作业share/hadoop/MapReduce/hadoop-MapReduce-examples-2.6.0.jar,我发现该作业已被接受,但始终处于挂起状态

我从非常基本的伪分布式配置开始Hadoop:

<?xml version="1.0"?>
<!-- core-site.xml -->
<configuration>
  <property>
    <name>fs.defaultFS</name>
    <value>hdfs://localhost/</value>
  </property>
</configuration>

<?xml version="1.0"?>
<!-- hdfs-site.xml -->
<configuration>
  <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>
</configuration>

<?xml version="1.0"?>
<!-- mapred-site.xml -->
<configuration>
  <property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
  </property>
</configuration>

<?xml version="1.0"?>
<!-- yarn-site.xml -->
<configuration>
  <property>
    <name>yarn.resourcemanager.hostname</name>
    <value>localhost</value>
  </property>
  <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
  </property>
</configuration>
在节点管理器日志中:

2015-05-21 15:02:10,823 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Node 192.168.11.2:54225 reported UNHEALTHY with details: 1/1 local-dirs are bad: /tmp/hadoop-stephen/nm-local-dir; 1/1 log-dirs are bad: /Users/stephen/devel/hadoop-2.6.0/logs/userlogs
2015-05-21 15:02:09,716 ERROR org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService: Most of the disks failed. 1/1 local-dirs are bad: /tmp/hadoop-stephen/nm-local-dir; 1/1 log-dirs are bad: /Users/stephen/devel/hadoop-2.6.0/logs/userlogs
我甚至看到在资源管理器页面中有一个不健康的节点,端口是8088。即使我一次又一次地删除文件系统和hdfs namenode-format,我也会看到同样的错误

现在,我只能猜测我的坏节点/不健康节点使我的MR作业始终处于待定状态,如果我是对的,如何修复它

我可以使用相同的配置使Hadoop 2.5.2成功运行。 环境:Mac Yosemite,Oracle JDK 1.7.0_79


谢谢

你能发布你的日志吗?没有日志,你很难帮助你。我修改了我的问题