Hadoop Oozie地图减少永远处于准备状态的作业
我正在尝试运行wordcount映射reduce示例,参考 我在集群设置中使用hadoop 2.2.0 问题是我的oozie map reduce作业一直在运行。它没有给出任何错误,但没有成功完成。没有错误消息。也没有创建输出目录(假设会发生这种情况) 下面是workflow.xmlHadoop Oozie地图减少永远处于准备状态的作业,hadoop,mapreduce,oozie,Hadoop,Mapreduce,Oozie,我正在尝试运行wordcount映射reduce示例,参考 我在集群设置中使用hadoop 2.2.0 问题是我的oozie map reduce作业一直在运行。它没有给出任何错误,但没有成功完成。没有错误消息。也没有创建输出目录(假设会发生这种情况) 下面是workflow.xml <workflow-app xmlns="uri:oozie:workflow:0.1" name="map-reduce-wf"> <start to="mr-node"/>
<workflow-app xmlns="uri:oozie:workflow:0.1" name="map-reduce-wf">
<start to="mr-node"/>
<action name="mr-node">
<map-reduce>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<prepare>
<delete path="${nameNode}/user/hadoop/${examplesRoot}/output-data/${outputDir}"/>
</prepare>
<configuration>
<property>
<name>mapred.mapper.new-api</name>
<value>true</value>
</property>
<property>
<name>mapred.reducer.new-api</name>
<value>true</value>
</property>
<property>
<name>mapred.job.queue.name</name>
<value>${queueName}</value>
</property>
<property>
<name>mapreduce.map.class</name>
<value>org.apache.hadoop.examples.WordCount$TokenizerMapper</value>
</property>
<property>
<name>mapreduce.reduce.class</name>
<value>org.apache.hadoop.examples.WordCount$IntSumReducer</value>
</property>
<property>
<name>mapreduce.combine.class</name>
<value>org.apache.hadoop.examples.WordCount$IntSumReducer</value>
</property>
<property>
<name>mapred.output.key.class</name>
<value>org.apache.hadoop.io.Text</value>
</property>
<property>
<name>mapred.output.value.class</name>
<value>org.apache.hadoop.io.IntWritable</value>
</property>
<property>
<name>mapred.input.dir</name>
<value>/user/hadoop/${examplesRoot}/input-data/text</value>
</property>
<property>
<name>mapred.output.dir</name>
<value>/user/hadoop/${examplesRoot}/output-data/${outputDir}</value>
</property>
</configuration>
</map-reduce>
<ok to="end"/>
<error to="fail"/>
</action>
<kill name="fail">
<message>Map/Reduce failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>
作业状态的输出为
Workflow Name : map-reduce-wf
App Path : hdfs://hadoopmaster:54310/user/hadoop/examplesoozie/map-reduce
Status : RUNNING
Run : 0
User : hadoopuser
Group : -
Created : 2014-10-26 19:52 GMT
Started : 2014-10-26 19:52 GMT
Last Modified : 2014-10-26 19:52 GMT
Ended : -
CoordAction ID: -
Actions
------------------------------------------------------------------------------------------------------------------------------------
ID Status Ext ID Ext Status Err Code
------------------------------------------------------------------------------------------------------------------------------------
0000006-141026135258981-oozie-hado-W@:start: OK - OK -
------------------------------------------------------------------------------------------------------------------------------------
0000006-141026135258981-oozie-hado-W@mr-node PREP - - -
------------------------------------------------------------------------------------------------------------------------------------
任何帮助都将不胜感激。在job.properties初始数据集中,应在作业开始前8小时(PST为GMT-8)。您已经为这两个项目设置了2014-10-26 19:52 GMT 我看不到您的workflow.xml中定义的mapreduce jar。你能检查一下你是否遗漏了jar命令吗?我的意思是你的jar在lib文件夹中吗?它的类名和工作流中的类名相同。xml@KSNidhin:是的,我已将jar包含在map reduce文件夹的lib文件夹中,并且类名与定义的类名相同。嗨,Ramanan,我们尚未设置任何协调作业。我们只是在运行简单的oozie蜂巢作业。那么,我们还必须为工作流设置jobStart和jobEnd吗?我们已经在oozie.processing.timezone中设置了时区,但它仍然不起作用。
Workflow Name : map-reduce-wf
App Path : hdfs://hadoopmaster:54310/user/hadoop/examplesoozie/map-reduce
Status : RUNNING
Run : 0
User : hadoopuser
Group : -
Created : 2014-10-26 19:52 GMT
Started : 2014-10-26 19:52 GMT
Last Modified : 2014-10-26 19:52 GMT
Ended : -
CoordAction ID: -
Actions
------------------------------------------------------------------------------------------------------------------------------------
ID Status Ext ID Ext Status Err Code
------------------------------------------------------------------------------------------------------------------------------------
0000006-141026135258981-oozie-hado-W@:start: OK - OK -
------------------------------------------------------------------------------------------------------------------------------------
0000006-141026135258981-oozie-hado-W@mr-node PREP - - -
------------------------------------------------------------------------------------------------------------------------------------