Airflow 气流印刷“;创建名为“dag”的dag;

Airflow 气流印刷“;创建名为“dag”的dag;,airflow,airflow-scheduler,Airflow,Airflow Scheduler,我已经创建了一堆本文中提到的气流DAG 因此,每当这个dag运行任务时,第一组日志总是下面提到的这些行 我想知道发生了什么,以及如何避免一次又一次地生成DAG {base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'foo_8', 'foo_task', '2020-11-11T05:55:13+00:00', '--job_id', '892884', '--pool', 'default_pool', '--raw', '-

我已经创建了一堆本文中提到的气流DAG

因此,每当这个dag运行任务时,第一组日志总是下面提到的这些行

我想知道发生了什么,以及如何避免一次又一次地生成DAG

{base_task_runner.py:133} INFO - Running: ['airflow', 'run', 'foo_8', 'foo_task', '2020-11-11T05:55:13+00:00', '--job_id', '892884', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/dynamic_generator.py', '--cfg_path', '/tmp/tmprqqeqh7o']
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task creating dag with name: foo_1
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task DAG Default Arguments: {'owner': 'TEST' 'retries': 5, 'retry_delay': datetime.timedelta(0, 60), 'email_on_failure': True, 'email_on_retry': False, 'start_date': datetime.datetime(2020, 11, 1, 0, 0, tzinfo=<Timezone [UTC]>), 'on_failure_callback': <function Email.alert at 0x7f3197460840>}
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task creating dag with name: foo_2
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task DAG Default Arguments: {'owner': 'TEST' 'retries': 5, 'retry_delay': datetime.timedelta(0, 60), 'email_on_failure': True, 'email_on_retry': False, 'start_date': datetime.datetime(2020, 11, 1, 0, 0, tzinfo=<Timezone [UTC]>), 'on_failure_callback': <function Email.alert at 0x7f3197460840>}
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task creating dag with name: foo_3
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task DAG Default Arguments: {'owner': 'TEST' 'retries': 5, 'retry_delay': datetime.timedelta(0, 60), 'email_on_failure': True, 'email_on_retry': False, 'start_date': datetime.datetime(2020, 11, 1, 0, 0, tzinfo=<Timezone [UTC]>), 'on_failure_callback': <function Email.alert at 0x7f3197460840>}
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task creating dag with name: foo_4
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task DAG Default Arguments: {'owner': 'TEST' 'retries': 5, 'retry_delay': datetime.timedelta(0, 60), 'email_on_failure': True, 'email_on_retry': False, 'start_date': datetime.datetime(2020, 11, 1, 0, 0, tzinfo=<Timezone [UTC]>), 'on_failure_callback': <function Email.alert at 0x7f3197460840>}
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task creating dag with name: foo_5
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task DAG Default Arguments: {'owner': 'TEST' 'retries': 5, 'retry_delay': datetime.timedelta(0, 60), 'email_on_failure': True, 'email_on_retry': False, 'start_date': datetime.datetime(2020, 11, 1, 0, 0, tzinfo=<Timezone [UTC]>), 'on_failure_callback': <function Email.alert at 0x7f3197460840>}
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task creating dag with name: foo_6
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task DAG Default Arguments: {'owner': 'TEST' 'retries': 5, 'retry_delay': datetime.timedelta(0, 60), 'email_on_failure': True, 'email_on_retry': False, 'start_date': datetime.datetime(2020, 11, 1, 0, 0, tzinfo=<Timezone [UTC]>), 'on_failure_callback': <function Email.alert at 0x7f3197460840>}
{base_task_runner.py:115} INFO - Job 892884: Subtask foo_task creating dag with name: foo_7 
{base_task_runner.py:133}INFO-Running:['aiffort','run','foo_8','foo_task','2020-11-11T05:55:13+00:00','--job_id','892884','--pool','default_pool','--raw','-sd','DAGS_FOLDER/dynamic_generator.py','--cfg_path','/tmp/tmprqqh7o']
{base_task_runner.py:115}INFO-作业892884:子任务foo_task创建名为foo_1的dag
{base_task_runner.py:115}INFO-Job 892884:Subtask foo_task DAG默认参数:{'owner':'TEST''retries':5',retry_delay':datetime.timedelta(0,60),'email_on_failure':True,'email_on_retry':False,'start_date日期:'datetime.datetime(2020,11,1,0,0,tzinfo=),'on_failure_callback':}
{base_task_runner.py:115}INFO-作业892884:子任务foo_task创建名为foo_2的dag
{base_task_runner.py:115}INFO-Job 892884:Subtask foo_task DAG默认参数:{'owner':'TEST''retries':5',retry_delay':datetime.timedelta(0,60),'email_on_failure':True,'email_on_retry':False,'start_date日期:'datetime.datetime(2020,11,1,0,0,tzinfo=),'on_failure_callback':}
{base_task_runner.py:115}INFO-作业892884:子任务foo_task创建名为foo_3的dag
{base_task_runner.py:115}INFO-Job 892884:Subtask foo_task DAG默认参数:{'owner':'TEST''retries':5',retry_delay':datetime.timedelta(0,60),'email_on_failure':True,'email_on_retry':False,'start_date日期:'datetime.datetime(2020,11,1,0,0,tzinfo=),'on_failure_callback':}
{base_task_runner.py:115}INFO-作业892884:子任务foo_task创建名为foo_4的dag
{base_task_runner.py:115}INFO-Job 892884:Subtask foo_task DAG默认参数:{'owner':'TEST''retries':5',retry_delay':datetime.timedelta(0,60),'email_on_failure':True,'email_on_retry':False,'start_date日期:'datetime.datetime(2020,11,1,0,0,tzinfo=),'on_failure_callback':}
{base_task_runner.py:115}INFO-作业892884:子任务foo_task创建名为foo_5的dag
{base_task_runner.py:115}INFO-Job 892884:Subtask foo_task DAG默认参数:{'owner':'TEST''retries':5',retry_delay':datetime.timedelta(0,60),'email_on_failure':True,'email_on_retry':False,'start_date日期:'datetime.datetime(2020,11,1,0,0,tzinfo=),'on_failure_callback':}
{base_task_runner.py:115}INFO-作业892884:子任务foo_task创建名为foo_6的dag
{base_task_runner.py:115}INFO-Job 892884:Subtask foo_task DAG默认参数:{'owner':'TEST''retries':5',retry_delay':datetime.timedelta(0,60),'email_on_failure':True,'email_on_retry':False,'start_date日期:'datetime.datetime(2020,11,1,0,0,tzinfo=),'on_failure_callback':}
{base_task_runner.py:115}INFO-作业892884:子任务foo_task创建名为foo_7的dag