Airflow 巴什多恩';t运行bash命令
我正在运行气流教程。tutorial.py中的内容如下:Airflow 巴什多恩';t运行bash命令,airflow,Airflow,我正在运行气流教程。tutorial.py中的内容如下: """ Code that goes along with the Airflow located at: http://airflow.readthedocs.org/en/latest/tutorial.html """ from airflow import DAG from airflow.operators.bash_operator import BashOperator from datetime import dateti
"""
Code that goes along with the Airflow located at:
http://airflow.readthedocs.org/en/latest/tutorial.html
"""
from airflow import DAG
from airflow.operators.bash_operator import BashOperator
from datetime import datetime, timedelta
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'start_date': datetime(2015, 6, 1),
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
# 'queue': 'bash_queue',
# 'pool': 'backfill',
# 'priority_weight': 10,
# 'end_date': datetime(2016, 1, 1),
}
dag = DAG(
'tutorial', default_args=default_args, schedule_interval=timedelta(1))
# t1, t2 and t3 are examples of tasks created by instantiating operators
t1 = BashOperator(
task_id='print_date',
bash_command='date',
dag=dag)
t2 = BashOperator(
task_id='sleep',
bash_command='sleep 5',
retries=3,
dag=dag)
templated_command = """
{% for i in range(5) %}
echo "{{ ds }}"
echo "{{ macros.ds_add(ds, 7)}}"
echo "{{ params.my_param }}"
{% endfor %}
"""
t3 = BashOperator(
task_id='templated',
bash_command=templated_command,
params={'my_param': 'Parameter I passed in'},
dag=dag)
t2.set_upstream(t1)
t3.set_upstream(t1)
tutorial.py位于~/afflow/dags下。通过运行气流列表_dags
我可以看到列表末尾的教程。
但是,当我运行日期为2018-09-04的气流测试教程打印时,它只打印:
[2018-09-04 22:14:43,096] {__init__.py:51} INFO - Using executor SequentialExecutor
[2018-09-04 22:14:43,199] {models.py:258} INFO - Filling up the DagBag from /Users/chenyuanfei/airflow/dags
没有别的了。
我在OSX上使用apche气流1.10。
如何才能正确运行脚本?我怀疑这是否是因为我的mac上同时安装了airflow1.8和apache-airflow1.10。
我卸载并重新安装了airflow1.8,这次它工作了dag打开了吗?如果它在web UIT中被关闭(默认情况下),它可能不会运行。这不应影响正在运行的测试。当你想安排时,就打开它。但您可以从命令行运行测试或回填。如果您尝试运行回填而不是测试,该怎么办?@Tomasz Krol It输出信息,如[2018-09-05 11:11:25025]{base_executor.py:56}信息-添加到队列:气流运行示例\u hello_world_dag date_task 2015-06-05T00:00:00+00:00-local-sd DAGS_FOLDER/tutorial.py-cfg\u path/var/folders/mg/kknt930j1\u n4ppyn2ydm4z2h0000gn/T/tmpZ\kdgv,但仍然没有我所期望的印刷品。我怀疑这是否是因为我的mac上同时有airflow1.8和apache-airflow1.10。我卸载并重新安装了airflow1.8,这次它正常工作了