Warning: file_get_contents(/data/phpspider/zhask/data//catemap/4/jquery-ui/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Hadoop。重新启动映射_Hadoop - Fatal编程技术网

Hadoop。重新启动映射

Hadoop。重新启动映射,hadoop,Hadoop,经过36个小时的工作,Hadoop 1.0.3说: INFO mapred.JobClient: map 42% reduce 0% mapred.JobClient: Job Failed: # of failed Map Tasks exceeded allowed limit. FailedCount: 1. java.io.IOException: Job failed! at org.apache.hadoop.mapred.JobClient.runJob(J

经过36个小时的工作,Hadoop 1.0.3说:

INFO mapred.JobClient:  map 42% reduce 0%
     mapred.JobClient: Job Failed: # of failed Map Tasks exceeded allowed limit. FailedCount: 1. 
     java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1265)
然后停了下来


是否可以不从一开始就重新启动Hadoop作业(映射0%减少0%)?

似乎没有一个好方法来重新启动失败的作业。要记住以下几点:

  • 看起来像是在mapred配置[mapreduce.map.maxtures=1]中创建的,默认值通常为4

    mapred.JobClient: Job Failed: # of failed Map Tasks 
    exceeded allowed limit. FailedCount: 1.
    
  • 您通常希望了解它失败的原因。(从您的帖子中不确定您是否发现了问题)

  • 它可能由于虚假原因而失败,您可以通过提供以下命令将此异常实现到mapreduce程序中。您可以使用Hadoop API实现相同的概念

    请在此处查看此答案: