Airflow 每月DAG计划每天凌晨2:30运行
我已经建立了一个DAG，开始日期为2021-04-02，计划间隔为每月第3天晚上11点。执行日期似乎工作正常，但DAG似乎每天2:30连续运行。我似乎找不出是怎么回事Airflow 每月DAG计划每天凌晨2:30运行,airflow,airflow-scheduler,Airflow,Airflow Scheduler,我已经建立了一个DAG，开始日期为2021-04-02，计划间隔为每月第3天晚上11点。执行日期似乎工作正常，但DAG似乎每天2:30连续运行。我似乎找不出是怎么回事 default_args = { 'owner': DAG_OWNER_NAME, 'email': ALERT_EMAIL_ADDRESSES, 'email_on_failure': True, 'email_on_retry': False, 'start_date': datetim
default_args = {
'owner': DAG_OWNER_NAME,
'email': ALERT_EMAIL_ADDRESSES,
'email_on_failure': True,
'email_on_retry': False,
'start_date': datetime(2021, 4, 2),
'retries': 0,
#'sla': timedelta(seconds=30),
'retry_delay': timedelta(minutes=1)
}
dag = DAG(DAG_ID, default_args=default_args, schedule_interval='0 23 3 * *',max_active_runs=1,catchup=False)
*** Reading local file: /home/lcg_airflow/airflow/logs/DAG_ID/TASK_ID/2021-04-03T23:00:00+00:00/1.log
[2021-05-03 23:00:20,576] {models.py:1359} INFO - Dependencies all met for <TaskInstance: DAG_ID.TASK_ID 2021-04-03T23:00:00+00:00 [queued]>
[2021-05-03 23:00:20,580] {models.py:1571} INFO -
--------------------------------------------------------------------------------
Starting attempt 1 of 1
--------------------------------------------------------------------------------
[2021-05-03 23:00:20,590] {models.py:1593} INFO - Executing <Task(EmailOperator): TASK_ID> on 2021-04-03T23:00:00+00:00
[2021-05-03 23:00:20,590] {base_task_runner.py:118} INFO - Running: ['bash', '-c', 'airflow run DAG_ID TASK_ID 2021-04-03T23:00:00+00:00 --job_id 1945275 --raw -sd DAGS_FOLDER/DAG_ID.py --cfg_path /tmp/tmpuebs1mob']
[2021-05-03 23:00:21,071] {base_task_runner.py:101} INFO - Job 1945275: Subtask TASK_ID [2021-05-03 23:00:21,070] {settings.py:174} INFO - settings.configure_orm(): Using pool settings. pool_size=5, pool_recycle=3600, pid=115477
[2021-05-03 23:00:21,625] {base_task_runner.py:101} INFO - Job 1945275: Subtask TASK_ID [2021-05-03 23:00:21,624] {__init__.py:51} INFO - Using executor CeleryExecutor
logs for task continue...
[2021-05-03 23:00:25,577] {logging_mixin.py:95} INFO - [2021-05-03 23:00:25,576] {jobs.py:2527} INFO - Task exited with return code 0
[2021-05-04 02:30:51,314] {models.py:1359} INFO - Dependencies all met for <TaskInstance: DAG_ID.TASK_ID 2021-04-03T23:00:00+00:00 [queued]>
[2021-05-04 02:30:51,317] {models.py:1359} INFO - Dependencies all met for <TaskInstance: DAG_ID.TASK_ID 2021-04-03T23:00:00+00:00 [queued]>
[2021-05-04 02:30:51,317] {models.py:1571} INFO -
--------------------------------------------------------------------------------
Starting attempt 1 of 1
--------------------------------------------------------------------------------
[2021-05-04 02:30:51,326] {models.py:1593} INFO - Executing <Task(EmailOperator): TASK_ID> on 2021-04-03T23:00:00+00:00
[2021-05-04 02:30:51,327] {base_task_runner.py:118} INFO - Running: ['bash', '-c', 'airflow run DAG_ID TASK_ID 2021-04-03T23:00:00+00:00 --job_id 1946386 --raw -sd DAGS_FOLDER/DAG_ID.py --cfg_path /tmp/tmpyccmvf2b']
[2021-05-04 02:30:51,790] {base_task_runner.py:101} INFO - Job 1946386: Subtask TASK_ID [2021-05-04 02:30:51,790] {settings.py:174} INFO - settings.configure_orm(): Using pool settings. pool_size=5, pool_recycle=3600, pid=42760
[2021-05-04 02:30:52,363] {base_task_runner.py:101} INFO - Job 1946386: Subtask TASK_ID [2021-05-04 02:30:52,362] {__init__.py:51} INFO - Using executor CeleryExecutor
logs for task continue and repeat every day at 2:30 AM...
***正在读取本地文件：/home/lcg\u气流/气流/日志/DAG\u ID/TASK\u ID/2021-04-03T23:00:00+00:00/1.log
[2021-05-03 23:00:20576]{models.py:1359}信息-所有依赖项都满足以下条件：
[2021-05-0323:00:20580]{models.py:1571}信息-
--------------------------------------------------------------------------------
开始尝试1次，共1次
--------------------------------------------------------------------------------
[2021-05-03 23:00:20590]{models.py:1593}INFO-在2021-04-03T23:00:00+00:00执行
[2021-05-03 23:00:20590]{base_task_runner.py:118}信息-运行：['bash'，'-c'，气流运行DAG_ID task_ID 2021-04-03T23:00:00+00:00--job_ID 1945275--raw-sd DAGS_文件夹/DAG_ID.py--cfg_path/tmp/tmpuebs1mob']
[2021-05-03 23:00:21071]{base_task_runner.py:101}信息-作业1945275:子任务任务ID[2021-05-03 23:00:21070]{settings.py:174}信息-设置。配置_orm（）：使用池设置。池大小=5，池回收=3600，pid=115477
[2021-05-03 23:00:21625]{base_task_runner.py:101}信息-作业1945275:子任务任务ID[2021-05-03 23:00:21624]{{u init__.py:51}信息-使用执行器CeleryExecutor
任务的日志继续。。。
[2021-05-03 23:00:25577]{logging_mixin.py:95}信息-[2021-05-03 23:00:25576]{jobs.py:2527}信息-任务已退出，返回代码为0
[2021-05-0402:30:51314]{models.py:1359}信息-所有依赖项都满足
[2021-05-0402:30:51317]{models.py:1359}信息-所有依赖项都满足
[2021-05-0402:30:51317]{models.py:1571}信息-
--------------------------------------------------------------------------------
开始尝试1次，共1次
--------------------------------------------------------------------------------
[2021-05-04 02:30:51326]{models.py:1593}INFO-在2021-04-03T23:00:00+00:00执行
[2021-05-04 02:30:51327]{base_task_runner.py:118}运行信息：['bash'，'-c'，气流运行DAG_ID task_ID 2021-04-03T23:00:00+00:00--job_ID 1946386--raw-sd DAGS_文件夹/DAG_ID.py--cfg_path/tmp/tmpyccmvf2b']
[2021-05-04 02:30:51790]{base_task_runner.py:101}INFO-作业1946386:Subtask task_ID[2021-05-04 02:30:51790]{settings.py:174}INFO-设置。configure_orm（）：使用池设置。池大小=5，池回收=3600，pid=42760
[2021-05-04 02:30:52363]{base_task_runner.py:101}信息-作业1946386:Subtask task_ID[2021-05-04 02:30:52362]{u_init__.py:51}信息-使用executor CeleryExecutor
任务日志将继续并在每天凌晨2:30重复。。。