Oozie工作流未正常运行
我已经基于下面的hql查询在Hue UI中创建了一个新的Oozie工作流 事物。hqlOozie工作流未正常运行,oozie,oozie-coordinator,Oozie,Oozie Coordinator,我已经基于下面的hql查询在Hue UI中创建了一个新的Oozie工作流 事物。hql drop table output_table; create table output_table like things; insert overwrite table output_table select t.* from things_dup td right outer join things t on (td.item_id = t.item_id) where td.item_id is nu
drop table output_table;
create table output_table like things;
insert overwrite table output_table select t.* from things_dup td right outer join things t on (td.item_id = t.item_id) where td.item_id is null;
insert overwrite table things_dup select * from things;
<workflow-app name="Things_workflow" xmlns="uri:oozie:workflow:0.4">
<start to="Things_workflow"/>
<action name="Things_workflow">
<hive xmlns="uri:oozie:hive-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<job-xml>/user/cloudera/hive-site.xml</job-xml>
<script>things.hql</script>
<file>/user/cloudera/hive-site.xml#hive-site.xml</file>
</hive>
<ok to="end"/>
<error to="kill"/>
</action>
<kill name="kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>
桌子是,
事物表
item_id product
1 soap
2 chocklate
事情重复
item_id product
1 soap
当我单独运行hql时
hadoop dfs-f things.hql
工作正常。dup表中的内容已正确更新
但当我运行工作流时,dup表中的内容没有更新。
插入覆盖表内容\u dup从内容中选择*
有人知道为什么吗?请帮我解决这个问题
Workflow.xml
drop table output_table;
create table output_table like things;
insert overwrite table output_table select t.* from things_dup td right outer join things t on (td.item_id = t.item_id) where td.item_id is null;
insert overwrite table things_dup select * from things;
<workflow-app name="Things_workflow" xmlns="uri:oozie:workflow:0.4">
<start to="Things_workflow"/>
<action name="Things_workflow">
<hive xmlns="uri:oozie:hive-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<job-xml>/user/cloudera/hive-site.xml</job-xml>
<script>things.hql</script>
<file>/user/cloudera/hive-site.xml#hive-site.xml</file>
</hive>
<ok to="end"/>
<error to="kill"/>
</action>
<kill name="kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>
${jobTracker}
${nameNode}
/user/cloudera/hive-site.xml
things.hql
/user/cloudera/hive-site.xml#hive-site.xml
操作失败,错误消息[${wf:errorMessage(wf:lastErrorNode())}]
行动
<hive xmlns="uri:oozie:hive-action:0.2">
<job-tracker>localhost.localdomain:8021</job-tracker>
<name-node>hdfs://localhost.localdomain:8020</name-node>
<job-xml>/user/cloudera/hive-site.xml</job-xml>
<script>things.hql</script>
<file>/user/cloudera/hive-site.xml#hive-site.xml</file>
</hive>
localhost.localdomain:8021
hdfs://localhost.localdomain:8020
/user/cloudera/hive-site.xml
things.hql
/user/cloudera/hive-site.xml#hive-site.xml
谢谢,
manimekalai我也遇到了蜂巢oozie的问题,但最终解决了 请将您的workflow.xml与此匹配 请将此作业xml行置于配置节点之前
<?xml version="1.0" encoding="UTF-8"?>
<workflow-app xmlns="uri:oozie:workflow:0.2" name="pig-hive-wf">
<start to="hive-node" />
<action name="hive-node">
<hive xmlns="uri:oozie:hive-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<job-xml>hive-site.xml</job-xml>
<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>${queueName}</value>
</property>
<property>
<name>oozie.hive.defaults</name>
<value>/user/cloudera/oozie/pig_hive_data_WF/hive-site.xml</value>
</property>
</configuration>
<script>/user/cloudera/oozie/pig_hive_data_WF/load_data.q</script>
<param>LOCATION=/user/${wf:user()}/oozie/pig_hive_data_WF/output/pig_loaded_data</param>
<file>hive-conf.xml#hive-conf.xml</file>
</hive>
<ok to="end"/>
<error to="fail"/>
</action>
<kill name="fail">
<message>Pig Hive job is failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end" />
</workflow-app>
${jobTracker}
${nameNode}
hive-site.xml
mapred.job.queue.name
${queueName}
oozie.hive.defaults
/user/cloudera/oozie/pig\u hive\u data\u WF/hive-site.xml
/user/cloudera/oozie/pig\u hive\u data\u WF/load\u data.q
LOCATION=/user/${wf:user()}/oozie/pig\u hive\u data\u wf/output/pig\u loaded\u data
hive-conf.xml#hive-conf.xml
Pig配置单元作业失败,错误消息[${wf:errorMessage(wf:lastErrorNode())}]
您可以从/etc/hive/conf/hive site.xml复制hive-site.xml文件,并将其放入工作流目录中 请发布您的workflow.xml
workflow.xml
以及您看到的错误是什么。请检查已启动的配置单元操作作业的日志。谢谢。谢谢你的回复。我没有写任何XML。我已经通过HUE UI Oozie editor创建了一个工作流。HUE UI Oozie editor生成一个workflow.xml。你可以检查一下。还有,你用哪种Oozie动作来做这个?