oozie工作流shellAction
我正在尝试使用包含以下命令的shell脚本在oozie工作流中运行shell操作:oozie工作流shellAction,shell,hadoop,hdfs,oozie,Shell,Hadoop,Hdfs,Oozie,我正在尝试使用包含以下命令的shell脚本在oozie工作流中运行shell操作: .#!/bin/bash hadoop fs -mkdir /user/mathon_k/shell_dir .#echo "hello " 我得到以下错误: Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1] 日志 2014-03-28 15:11:31951信息 org.apache.oozie.command.wf
.#!/bin/bash
hadoop fs -mkdir /user/mathon_k/shell_dir
.#echo "hello "
我得到以下错误:
Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]
日志
2014-03-28 15:11:31951信息
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
动作[0000028-140328083804680-oozie-oozi-W@:start:]开始动作
[0000028-140328083804680-oozie-oozi-W@:start:]具有用户重试状态:
userRetryCount[0],userRetryMax[0],userRetryInterval[10]
2014-03-28 15:11:31952警告
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@:开始:]
[0000028-140328083804680-oozie-oozi-W@:开始:]操作状态=完成
2014-03-28 15:11:31952警告
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@:开始:]
[0000028-140328083804680-oozie-oozi-W@:开始:]中更新的操作
DB!2014-03-28 15:11:32027信息
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]开始
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]与
用户重试状态:userRetryCount[0],userRetryMax[0],
userRetryInterval[10]2014-03-28 15:11:32170警告
org.apache.oozie.action.hadoop.ShellActionExecutor:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]
操作的凭据为空2014-03-28 15:11:32669信息
org.apache.oozie.action.hadoop.ShellActionExecutor:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]检查
操作,外部ID[job_201403280835_0020]状态[正在运行]
2014-03-28 15:11:32772警告
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]
[*0000028-140328083804680-oozie-oozi-W@oozie_20140328*]行动
状态=正在运行2014-03-28 15:11:32772警告
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]
[*0000028-140328083804680-oozie-oozi-W@oozie_20140328*]行动
数据库更新!2014-03-28 15:11:45254信息
org.apache.oozie.servlet.CallbackServlet:用户[-]组[-]令牌[-]
APP[-]作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]回拨
行动[0000028-140328083804680-oozie-oozi]-W@oozie_20140328]
2014-03-28 15:11:45332信息
org.apache.oozie.action.hadoop.ShellActionExecutor:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]行动
已完成,外部ID[job_201403280835_0020]2014-03-28 15:11:45358
WARN org.apache.oozie.action.hadoop.ShellActionExecutor:
用户[mathon_k]组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]发射装置
错误,原因:Main类[org.apache.oozie.action.hadoop.ShellMain],
出口代码[1]2014-03-28 15:11:45518信息
org.apache.oozie.command.wf.ActionEndXCommand:用户[mathon_k]组[-]
令牌[]应用程序[oo_20140328]作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]错误是
SLA 2014-03-28 15:11:45563信息被视为失败
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@kill]开始行动
[0000028-140328083804680-oozie-oozi-W@kill]用户重试状态为:
userRetryCount[0],userRetryMax[0],userRetryInterval[10]
2014-03-28 15:11:45563警告
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@kill]
[0000028-140328083804680-oozie-oozi-W@kill]操作状态=完成
2014-03-28 15:11:45563警告
org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k]
组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]
行动[0000028-140328083804680-oozie-oozi-W@kill]
[0000028-140328083804680-oozie-oozi-W@kill]操作已在数据库中更新!
2014-03-28 15:11:45626警告
org.apache.oozie.command.coord.coordActionUpdateExcomand:
用户[mathon_k]组[-]令牌[]应用程序[oo_20140328]
作业[0000028-140328083804680-oozie-oozi-W]操作[-]E1100:命令
先决条件在执行之前不成立,[,coord action为null],
错误代码:E1100
但是,当我将shell脚本更改为以下内容时,它工作得很好
.#!/bin/bash
.#hadoop fs -mkdir /user/mathon_k/shell_dir
echo "hello "
由于安全问题,我们还遇到了在Oozie中发出hadoop shell命令的问题。 您使用的是哪个版本的Hadoop?哪个版本的oozie
对于初学者,在执行HADOOP命令之前,请尝试将HADOOP_USER_NAME设置为要执行HADOOP命令的用户名。如果要使用mkdir-use
如果您想运行bash-看起来它工作得很好您好,非常感谢您的建议,但我使用上面的shell脚本只是为了测试,但我的项目的实际脚本是:#/bin/bash#使用今天的日期和时间