Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/docker/9.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Hadoop 如何使用简单的输入事件设置Oozie协调器?_Hadoop_Oozie_Oozie Coordinator - Fatal编程技术网

Hadoop 如何使用简单的输入事件设置Oozie协调器?

Hadoop 如何使用简单的输入事件设置Oozie协调器?,hadoop,oozie,oozie-coordinator,Hadoop,Oozie,Oozie Coordinator,如何设置Oozie coordinator输入事件,该事件可以存在也可以不存在?请填写表格???有关下列事项: <coordinator-app name="${jobName}" frequency="${coord:days(1)}" start="${startTime}" end="${endTime}" timezone="${timezone}" xmlns="uri:oozie:coordinator:0.2"> <controls>

如何设置Oozie coordinator输入事件,该事件可以存在也可以不存在?请填写表格???有关下列事项:

<coordinator-app name="${jobName}" frequency="${coord:days(1)}" start="${startTime}" end="${endTime}" timezone="${timezone}" xmlns="uri:oozie:coordinator:0.2">
    <controls>
        <timeout>-1</timeout>
        <concurrency>30</concurrency>
        <execution>FIFO</execution>
    </controls>

    <datasets>
        <dataset name="myData" frequency="???" initial-instance="???" timezone="UTC">
            <uri-template>/time-independent/path/that/may/or/maynot/be/there</uri-template>
        </dataset>
    </datasets>

    <input-events>
        <data-in name="myInput" dataset="myData">
            <instance>???</instance>
        </data-in>
    </input-events>

    <action>
        <workflow>
            <app-path>${myAppPath}</app-path>
            <configuration>
                <property>
                    <name>myInput</name>
                    <value>${coord:dataIn('myInput')}</value>
                </property>
            </configuration>
        </workflow>
    </action>

</coordinator-app>

-1
30
先进先出
/时间无关/路径/可能/或/可能不在/那里
???
${myAppPath}
我的输入
${coord:dataIn('myInput')}
谢谢,
Alvaro

数据集频率值将为${coord:days(1)},因为您希望为每天安排它

starttime将是您希望开始作业时的值。例如2017-01-22T12:00Z.

因此,更新后的协调器xml如下所示:

<coordinator-app name="${jobName}" frequency="${coord:days(1)}" start="${startTime}" end="${endTime}" timezone="${timezone}"
    xmlns="uri:oozie:coordinator:0.2">
    <controls>
        <timeout>-1</timeout>
        <concurrency>30</concurrency>
        <execution>FIFO</execution>
    </controls>
    <datasets>
        <dataset name="myData" frequency="${coord:days(1)}" initial-instance="${startTime}" timezone="UTC">
            <uri-template>/time-independent/path/that/may/or/maynot/be/there</uri-template>
        </dataset>
    </datasets>
    <input-events>
        <data-in name="myInput" dataset="myData">
            <instance>${startTime}</instance>
        </data-in>
    </input-events>
    <action>
        <workflow>
            <app-path>${myAppPath}</app-path>
            <configuration>
                <property>
                    <name>myInput</name>
                    <value>${coord:dataIn('myInput')}</value>
                </property>
            </configuration>
        </workflow>
    </action>
</coordinator-app>

-1
30
先进先出
/时间无关/路径/可能/或/可能不在/那里
${startTime}
${myAppPath}
我的输入
${coord:dataIn('myInput')}

是否可以定义可选的输入事件

例如: 我定义了4个输入事件。。A、B、C和D

看起来我们必须使用所有的数据集