Windows Hadoop字数示例
在成功创建hadoop环境之后,当我打算在hadoop版本0.19.1中运行这个wordcount示例时,它会给我一个错误,比如,如何解决这个问题Windows Hadoop字数示例,windows,eclipse,hadoop,cygwin,mapreduce,Windows,Eclipse,Hadoop,Cygwin,Mapreduce,在成功创建hadoop环境之后,当我打算在hadoop版本0.19.1中运行这个wordcount示例时,它会给我一个错误,比如,如何解决这个问题 11/12/30 06:46:13 INFO mapred.FileInputFormat: Total input paths to process : 1 11/12/30 06:46:14 INFO mapred.JobClient: Running job: job_201112300255_0019 11/12/30 06:46:15
11/12/30 06:46:13 INFO mapred.FileInputFormat: Total input paths to process : 1
11/12/30 06:46:14 INFO mapred.JobClient: Running job: job_201112300255_0019
11/12/30 06:46:15 INFO mapred.JobClient: map 0% reduce 0%
11/12/30 06:46:20 INFO mapred.JobClient: Task Id : attempt_201112300255_0019_m_000003_0, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
11/12/30 06:46:24 INFO mapred.JobClient: Task Id : attempt_201112300255_0019_m_000003_1, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
11/12/30 06:46:28 INFO mapred.JobClient: Task Id : attempt_201112300255_0019_m_000003_2, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
11/12/30 06:46:35 INFO mapred.JobClient: Task Id : attempt_201112300255_0019_m_000002_0, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
11/12/30 06:46:39 INFO mapred.JobClient: Task Id : attempt_201112300255_0019_m_000002_1, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
11/12/30 06:46:44 INFO mapred.JobClient: Task Id : attempt_201112300255_0019_m_000002_2, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
at word.count.WordCount.main(WordCount.java:53)
Please help me out to resolve this error.
您使用的hadoop版本有一个作业跟踪器来管理整个作业。对于该工作的每个子部分(称为任务),都有一个实际执行该工作的任务跟踪器。 您提供的输出是job tracker输出,本质上是这样的:任务失败。 要想弄清楚任务中到底出了什么问题,必须查看属于失败任务的日志文件 您可以通过集群的mapreduce web界面访问这些日志。只有错误代码(1)而没有堆栈跟踪,很难识别问题,请检查日志文件中是否有任何错误/警告。另外,是否有任何理由使用0.19.1,它是2年前发布的?