Docker 当我尝试跑步时,DAG显示Ooops
我正在尝试运行DAG,但它显示以下错误。它工作了几个月,直到昨天。有人知道会发生什么吗?我正在发送下面的日志 我在Docker和Kubernetes一起工作 Kubectl版本:Docker 当我尝试跑步时,DAG显示Ooops,docker,kubernetes,airflow,Docker,Kubernetes,Airflow,我正在尝试运行DAG,但它显示以下错误。它工作了几个月,直到昨天。有人知道会发生什么吗?我正在发送下面的日志 我在Docker和Kubernetes一起工作 Kubectl版本: Server Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.11", GitCommit:"d94a81c724ea8e1ccc9002d89b7fe81d58f89ed
Server Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.11", GitCommit:"d94a81c724ea8e1ccc9002d89b7fe81d58f89ede", GitTreeState:"clean", BuildDate:"2020-03-12T21:00:06Z", GoVersion:"go1.12.17", Compiler:"gc", Platform:"linux/amd64"}
日志:
节点:soma4-6f7b46b685-5rf7z
-------------------------------------------------------------------------------
回溯(最近一次呼叫最后一次):
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/engine/base.py”,第1224行,在执行上下文中
游标、语句、参数、上下文
do_ExecuteMy中的文件“/usr/local/lib/python3.6/site packages/sqlalchemy/engine/default.py”,第549行
cursor.executemany(语句、参数)
sqlite3.IntegrityError:非空约束失败:任务\实例.pool
上述异常是以下异常的直接原因:
回溯(最近一次呼叫最后一次):
wsgi_应用程序中的文件“/usr/local/lib/python3.6/site packages/flask/app.py”,第2317行
response=self.full\u dispatch\u request()
文件“/usr/local/lib/python3.6/site packages/flask/app.py”,第1840行,完整发送请求
rv=自身处理用户异常(e)
文件“/usr/local/lib/python3.6/site packages/flask/app.py”,第1743行,在handle\u user\u异常中
重放(exc_类型、exc_值、tb)
文件“/usr/local/lib/python3.6/site packages/flask/_compat.py”,第36行,重新登录
增值
文件“/usr/local/lib/python3.6/site packages/flask/app.py”,第1838行,完整发送请求
rv=自我分派请求()
文件“/usr/local/lib/python3.6/site packages/flask/app.py”,第1824行,在调度请求中
返回self.view_函数[rule.endpoint](**req.view_参数)
文件“/usr/local/lib/python3.6/site packages/flask_admin/base.py”,第69行,内部
返回自我。运行视图(f,*args,**kwargs)
文件“/usr/local/lib/python3.6/site packages/flask\u admin/base.py”,第368行,在运行视图中
返回fn(自身、*args、**kwargs)
文件“/usr/local/lib/python3.6/site packages/flask\u login/utils.py”,第258行,在视图中
返回函数(*args,**kwargs)
文件“/usr/local/lib/python3.6/site packages/afflow/www/utils.py”,第275行,在包装器中
返回f(*args,**kwargs)
文件“/usr/local/lib/python3.6/site packages/afflow/www/utils.py”,第322行,在包装器中
返回f(*args,**kwargs)
文件“/usr/local/lib/python3.6/site packages/afflow/utils/db.py”,第73行,在包装器中
返回函数(*args,**kwargs)
文件“/usr/local/lib/python3.6/site packages/afflow/www/views.py”,第1138行,在触发器中
外部触发=真
文件“/usr/local/lib/python3.6/site packages/afflow/utils/db.py”,第73行,在包装器中
返回函数(*args,**kwargs)
文件“/usr/local/lib/python3.6/site packages/afflow/models/________.py”,第2931行,在create_dagrun中
会话=会话)
文件“/usr/local/lib/python3.6/site packages/afflow/utils/db.py”,第69行,在包装器中
返回函数(*args,**kwargs)
文件“/usr/local/lib/python3.6/site packages/afflow/models/_______.py”,第4084行,在create_dagrun中
运行。验证_完整性(会话=会话)
文件“/usr/local/lib/python3.6/site packages/afflow/utils/db.py”,第69行,在包装器中
返回函数(*args,**kwargs)
文件“/usr/local/lib/python3.6/site packages/afflow/models/__init__.py”,第4922行,位于验证完整性中
session.commit()
提交中的文件“/usr/local/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第1026行
self.transaction.commit()
提交中的文件“/usr/local/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第493行
self.\u prepare\u impl()
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第472行,在
self.session.flush()
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第2451行,刷新
自冲洗(对象)
文件“/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/session.py”,第2589行,在
事务.rollback(\u capture\u exception=True)
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/util/langhelpers.py”,第68行,在__
兼容性(exc_类型、exc_值、exc_tb)
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/util/compat.py”,第129行,在reraise中
增值
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第2549行,在\u flush中
flush_context.execute()
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/orm/unitofwork.py”,执行中的第422行
rec.execute(self)
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/orm/unitofwork.py”,执行中的第589行
uow,
save_obj中的文件“/usr/local/lib/python3.6/site packages/sqlalchemy/orm/persistence.py”,第245行
插入,
文件“/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/persistence.py”,第1066行,在发出插入语句中
c=缓存的连接[connection]。执行(语句,多内存)
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/engine/base.py”,执行中的第988行
返回方法(自身、多线程、参数)
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/sql/elements.py”,第287行,在连接上执行
返回连接。_execute_clauseelement(self、multiparams、params)
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/engine/base.py”,第1107行,在执行条款元素中
你的参数,
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/engine/base.py”,第1248行,在执行上下文中
e、 语句、参数、游标、上下文
文件“/usr/local/lib/python3.6/site packages/sqlalchemy/engine/base.py”,第1466行,在_handle_dbapi_exception中
util.raise\u from\u cause(sqlalchemy\u异常,exc\u信息)
文件“/usr/local/lib/python3.6/site-packages/sqlalchemy/util/compat.py”,第383行,从原因开始
重新释放(类型(异常),异常,tb=exc\U tb,原因=原因)
文件“/usr/local/lib/python3.6/site-packages/sqlalchemy/util/compat.py”,第128行,重新登录
通过回溯(tb)提高价值
Node: soma4-6f7b46b685-5rf7z
-------------------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1224, in _execute_context
cursor, statement, parameters, context
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 549, in do_executemany
cursor.executemany(statement, parameters)
sqlite3.IntegrityError: NOT NULL constraint failed: task_instance.pool
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 2317, in wsgi_app
response = self.full_dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1840, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1743, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/usr/local/lib/python3.6/site-packages/flask/_compat.py", line 36, in reraise
raise value
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1838, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1824, in dispatch_request
return self.view_functions[rule.endpoint](**req.view_args)
File "/usr/local/lib/python3.6/site-packages/flask_admin/base.py", line 69, in inner
return self._run_view(f, *args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_admin/base.py", line 368, in _run_view
return fn(self, *args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_login/utils.py", line 258, in decorated_view
return func(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/airflow/www/utils.py", line 275, in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/airflow/www/utils.py", line 322, in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/airflow/utils/db.py", line 73, in wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/airflow/www/views.py", line 1138, in trigger
external_trigger=True
File "/usr/local/lib/python3.6/site-packages/airflow/utils/db.py", line 73, in wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/airflow/models/__init__.py", line 2931, in create_dagrun
session=session)
File "/usr/local/lib/python3.6/site-packages/airflow/utils/db.py", line 69, in wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/airflow/models/__init__.py", line 4084, in create_dagrun
run.verify_integrity(session=session)
File "/usr/local/lib/python3.6/site-packages/airflow/utils/db.py", line 69, in wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/airflow/models/__init__.py", line 4922, in verify_integrity
session.commit()
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 1026, in commit
self.transaction.commit()
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 493, in commit
self._prepare_impl()
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 472, in _prepare_impl
self.session.flush()
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 2451, in flush
self._flush(objects)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 2589, in _flush
transaction.rollback(_capture_exception=True)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__
compat.reraise(exc_type, exc_value, exc_tb)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 129, in reraise
raise value
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 2549, in _flush
flush_context.execute()
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute
rec.execute(self)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/unitofwork.py", line 589, in execute
uow,
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj
insert,
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/persistence.py", line 1066, in _emit_insert_statements
c = cached_connections[connection].execute(statement, multiparams)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 988, in execute
return meth(self, multiparams, params)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/sql/elements.py", line 287, in _execute_on_connection
return connection._execute_clauseelement(self, multiparams, params)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1107, in _execute_clauseelement
distilled_params,
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1248, in _execute_context
e, statement, parameters, cursor, context
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1466, in _handle_dbapi_exception
util.raise_from_cause(sqlalchemy_exception, exc_info)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 383, in raise_from_cause
reraise(type(exception), exception, tb=exc_tb, cause=cause)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 128, in reraise
raise value.with_traceback(tb)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1224, in _execute_context
cursor, statement, parameters, context
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 549, in do_executemany
cursor.executemany(statement, parameters)
sqlalchemy.exc.IntegrityError: (sqlite3.IntegrityError) NOT NULL constraint failed: task_instance.pool
[SQL: INSERT INTO task_instance (task_id, dag_id, execution_date, start_date, end_date, duration, state, try_number, max_tries, hostname, unixname, job_id, pool, queue, priority_weight, operator, queued_dttm, pid, executor_config) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)]
[parameters: (('ingest_scada_alarms', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 40, None, None, None, <memory at 0x7fde8adda588>), ('ingest_sgm_master', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 39, None, None, None, <memory at 0x7fde8adda7c8>), ('ingest_sgm_register', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 33, None, None, None, <memory at 0x7fde8adda888>), ('ingest_sgm_maint', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 38, None, None, None, <memory at 0x7fde8adda948>), ('ingest_dw_failures', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 37, None, None, None, <memory at 0x7fde8addaa08>), ('ingest_dw_failures_short', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 36, None, None, None, <memory at 0x7fde8addaac8>), ('ingest_nc_lightning', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 35, None, None, None, <memory at 0x7fde8addab88>), ('ingest_im_metereo', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 34, None, None, None, <memory at 0x7fde8addac48>) ... displaying 10 of 40 total bound parameter sets ... ('call_update_ipdt', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 2, None, None, None, <memory at 0x7fde8aa7d408>), ('send_email', 'soma_4_0_Modelo_Preditivo', '2020-10-08 12:37:10.604604', None, None, None, None, 0, 0, '', 'root', None, None, 'default', 1, None, None, None, <memory at 0x7fde8aa7d4c8>))]
(Background on this error at: http://sqlalche.me/e/gkpj)