Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/shell/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
oozie工作流shellAction_Shell_Hadoop_Hdfs_Oozie - Fatal编程技术网

oozie工作流shellAction

oozie工作流shellAction,shell,hadoop,hdfs,oozie,Shell,Hadoop,Hdfs,Oozie,我正在尝试使用包含以下命令的shell脚本在oozie工作流中运行shell操作: .#!/bin/bash hadoop fs -mkdir /user/mathon_k/shell_dir .#echo "hello " 我得到以下错误: Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1] 日志 2014-03-28 15:11:31951信息 org.apache.oozie.command.wf

我正在尝试使用包含以下命令的shell脚本在oozie工作流中运行shell操作:

.#!/bin/bash

hadoop fs -mkdir /user/mathon_k/shell_dir

.#echo "hello "
我得到以下错误:

Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]
日志

2014-03-28 15:11:31951信息 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 动作[0000028-140328083804680-oozie-oozi-W@:start:]开始动作 [0000028-140328083804680-oozie-oozi-W@:start:]具有用户重试状态: userRetryCount[0],userRetryMax[0],userRetryInterval[10] 2014-03-28 15:11:31952警告 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@:开始:] [0000028-140328083804680-oozie-oozi-W@:开始:]操作状态=完成 2014-03-28 15:11:31952警告 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@:开始:] [0000028-140328083804680-oozie-oozi-W@:开始:]中更新的操作 DB!2014-03-28 15:11:32027信息 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]开始 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]与 用户重试状态:userRetryCount[0],userRetryMax[0], userRetryInterval[10]2014-03-28 15:11:32170警告 org.apache.oozie.action.hadoop.ShellActionExecutor:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328] 操作的凭据为空2014-03-28 15:11:32669信息 org.apache.oozie.action.hadoop.ShellActionExecutor:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]检查 操作,外部ID[job_201403280835_0020]状态[正在运行] 2014-03-28 15:11:32772警告 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328] [*0000028-140328083804680-oozie-oozi-W@oozie_20140328*]行动 状态=正在运行2014-03-28 15:11:32772警告 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328] [*0000028-140328083804680-oozie-oozi-W@oozie_20140328*]行动 数据库更新!2014-03-28 15:11:45254信息 org.apache.oozie.servlet.CallbackServlet:用户[-]组[-]令牌[-] APP[-]作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]回拨 行动[0000028-140328083804680-oozie-oozi]-W@oozie_20140328] 2014-03-28 15:11:45332信息 org.apache.oozie.action.hadoop.ShellActionExecutor:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]行动 已完成,外部ID[job_201403280835_0020]2014-03-28 15:11:45358 WARN org.apache.oozie.action.hadoop.ShellActionExecutor: 用户[mathon_k]组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]发射装置 错误,原因:Main类[org.apache.oozie.action.hadoop.ShellMain], 出口代码[1]2014-03-28 15:11:45518信息 org.apache.oozie.command.wf.ActionEndXCommand:用户[mathon_k]组[-] 令牌[]应用程序[oo_20140328]作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@oozie_20140328]错误是 SLA 2014-03-28 15:11:45563信息被视为失败 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@kill]开始行动 [0000028-140328083804680-oozie-oozi-W@kill]用户重试状态为: userRetryCount[0],userRetryMax[0],userRetryInterval[10] 2014-03-28 15:11:45563警告 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@kill] [0000028-140328083804680-oozie-oozi-W@kill]操作状态=完成 2014-03-28 15:11:45563警告 org.apache.oozie.command.wf.ActionStartXCommand:USER[mathon_k] 组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W] 行动[0000028-140328083804680-oozie-oozi-W@kill] [0000028-140328083804680-oozie-oozi-W@kill]操作已在数据库中更新! 2014-03-28 15:11:45626警告 org.apache.oozie.command.coord.coordActionUpdateExcomand: 用户[mathon_k]组[-]令牌[]应用程序[oo_20140328] 作业[0000028-140328083804680-oozie-oozi-W]操作[-]E1100:命令 先决条件在执行之前不成立,[,coord action为null], 错误代码:E1100

但是,当我将shell脚本更改为以下内容时,它工作得很好

.#!/bin/bash

.#hadoop fs -mkdir /user/mathon_k/shell_dir

echo "hello "

由于安全问题,我们还遇到了在Oozie中发出hadoop shell命令的问题。 您使用的是哪个版本的Hadoop?哪个版本的oozie


对于初学者,在执行HADOOP命令之前,请尝试将HADOOP_USER_NAME设置为要执行HADOOP命令的用户名。

如果要使用mkdir-use


如果您想运行bash-看起来它工作得很好

您好,非常感谢您的建议,但我使用上面的shell脚本只是为了测试,但我的项目的实际脚本是:#/bin/bash#使用今天的日期和时间