Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/hadoop/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
如何使用hadoop2.2在oozie-4.0.1中执行pig-0.12.1工作流_Hadoop_Workflow_Apache Pig_Scheduling_Oozie - Fatal编程技术网

如何使用hadoop2.2在oozie-4.0.1中执行pig-0.12.1工作流

如何使用hadoop2.2在oozie-4.0.1中执行pig-0.12.1工作流,hadoop,workflow,apache-pig,scheduling,oozie,Hadoop,Workflow,Apache Pig,Scheduling,Oozie,我正在使用hadoop-2.2、oozie-4.0.1和pig-0.12.1。现在我将pig库文件移动到hdfs中的share/lib/pig。 在oozie中执行pig脚本时,它会进入运行状态,然后被杀死。它永远不会进入成功状态 日志中的错误: 2014-05-27 11:37:00,404 WARN PigActionExecutor:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-1

我正在使用hadoop-2.2、oozie-4.0.1和pig-0.12.1。现在我将pig库文件移动到hdfs中的share/lib/pig。 在oozie中执行pig脚本时,它会进入运行状态,然后被杀死。它永远不会进入成功状态

日志中的错误:

 2014-05-27 11:37:00,404  WARN PigActionExecutor:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@pigAction] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.PigMain], exit code [2]
 2014-05-27 11:37:00,522  INFO ActionEndXCommand:539 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@pigAction] ERROR is considered as FAILED for SLA
 2014-05-27 11:37:00,565  INFO ActionStartXCommand:539 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@killJobAction] Start action [0000011-140527092721822-oozie-labu-W@killJobAction] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
 2014-05-27 11:37:00,566  WARN ActionStartXCommand:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@killJobAction] [***0000011-140527092721822-oozie-labu-W@killJobAction***]Action status=DONE
 2014-05-27 11:37:00,566  WARN ActionStartXCommand:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@killJobAction] [***0000011-140527092721822-oozie-labu-W@killJobAction***]Action updated in DB!
 2014-05-27 11:37:00,629  WARN CoordActionUpdateXCommand:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[-] E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1100
这是我的工作流程:

<workflow-app name="WorkflowWithPigAction" xmlns="uri:oozie:workflow:0.1">
<start to="pigAction"/>
<action name="pigAction">
<pig>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<script>script.pig</script>
</pig>
<ok to="end"/>
<error to="killJobAction"/>
</action>
<kill name="killJobAction">
<message>"Killed job due to error: ${wf:errorMessage(wf:lastErrorNode())}"</message>
</kill>
<end name="end" />
</workflow-app>
我认为jar文件有问题。。。。有谁能告诉我在oozie-4.0.1和hadoop-2.2中pig-12.0.1需要哪些文件


帮帮我……

您似乎配置了一些错误。尝试新版本的oozie-4.1.0。你会成功的。如果你已经解决了这个问题,请告诉我。
nameNode=hdfs://localhost:8020
jobTracker=localhost:8032
queueName=default

oozie.libpath=${nameNode}/user/${user.name}/share/lib
oozie.use.system.libpath=true
oozie.wf.rerun.failnodes=true

oozieProjectRoot=${nameNode}/user/${user.name}/ooziepig
appPath=${oozieProjectRoot}/workflow.xml
oozie.wf.application.path=${appPath}