Airflow 在mac上运行气流计划程序时发生sqllite错误
运行“气流”时,我不断得到以下错误?有什么想法吗?这会在我启动气流调度器后立即发生。它以前工作正常,但在我更新mac时似乎停止了Airflow 在mac上运行气流计划程序时发生sqllite错误,airflow,airflow-scheduler,Airflow,Airflow Scheduler,运行“气流”时,我不断得到以下错误?有什么想法吗?这会在我启动气流调度器后立即发生。它以前工作正常,但在我更新mac时似乎停止了 Traceback (most recent call last): File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1248, in _execute_context curso
Traceback (most recent call last):
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1248, in _execute_context
cursor, statement, parameters, context
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 588, in do_execute
cursor.execute(statement, parameters)
sqlite3.OperationalError: no such table: job
然后是下面的回溯
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/Users/user1/.pyenv/versions/3.6.10/bin/airflow", line 37, in <module>
args.func(args)
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/airflow/utils/cli.py", line 76, in wrapper
return f(*args, **kwargs)
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/airflow/bin/cli.py", line 1221, in scheduler
job.run()
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/airflow/jobs/base_job.py", line 212, in run
session.commit()
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 1036, in commit
self.transaction.commit()
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 503, in commit
self._prepare_impl()
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 482, in _prepare_impl
self.session.flush()
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 2496, in flush
self._flush(objects)
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 2637, in _flush
transaction.rollback(_capture_exception=True)
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/util/langhelpers.py", line 69, in __exit__
exc_value, with_traceback=exc_tb,
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 178, in raise_
raise exception
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/session.py", line 2597, in _flush
flush_context.execute()
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute
rec.execute(self)
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/unitofwork.py", line 589, in execute
uow,
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj
insert,
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/persistence.py", line 1136, in _emit_insert_statements
statement, params
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 984, in execute
return meth(self, multiparams, params)
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/sql/elements.py", line 293, in _execute_on_connection
return connection._execute_clauseelement(self, multiparams, params)
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1103, in _execute_clauseelement
distilled_params,
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1288, in _execute_context
e, statement, parameters, cursor, context
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1482, in _handle_dbapi_exception
sqlalchemy_exception, with_traceback=exc_info[2], from_=e
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 178, in raise_
raise exception
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1248, in _execute_context
cursor, statement, parameters, context
File "/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 588, in do_execute
cursor.execute(statement, parameters)
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such table: job
[SQL: INSERT INTO job (dag_id, state, job_type, start_date, end_date, latest_heartbeat, executor_class, hostname, unixname) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)]
[parameters: (None, 'running', 'SchedulerJob', '2020-12-10 23:11:18.838822', None, '2020-12-10 23:11:18.838839', 'SequentialExecutor', 'ip-192-168-0-53.us-west-2.compute.internal', 'user1')]
(Background on this error at: http://sqlalche.me/e/e3q8)
上述异常是以下异常的直接原因:
回溯(最近一次呼叫最后一次):
文件“/Users/user1/.pyenv/versions/3.6.10/bin/afflow”,第37行,在
args.func(args)
包装中的文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/afflow/utils/cli.py”,第76行
返回f(*args,**kwargs)
调度器中的文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/afflow/bin/cli.py”,第1221行
job.run()
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/afflow/jobs/base_job.py”,第212行,运行中
session.commit()
提交中的文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第1036行
self.transaction.commit()
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/session.py”,提交中的第503行
self.\u prepare\u impl()
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第482行,在“准备”impl中
self.session.flush()
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第2496行,齐平
自冲洗(对象)
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/orm/session.py”,第2637行,在
事务.rollback(\u capture\u exception=True)
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/util/langhelpers.py”,第69行,在退出时__
exc_值,带有_回溯=exc_tb,
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/util/compat.py”,第178行,在raise中_
引发异常
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/session.py”,第2597行,在\u flush中
flush_context.execute()
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/unitofwork.py”,执行中第422行
rec.execute(self)
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/unitofwork.py”,执行中第589行
uow,
save_obj中的文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/persistence.py”,第245行
插入,
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/orm/persistence.py”,第1136行,在_emit\u insert\u语句中
声明,参数
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/engine/base.py”,执行中的第984行
返回方法(自身、多线程、参数)
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/sql/elements.py”,第293行,在连接上执行
返回连接。_execute_clauseelement(self、multiparams、params)
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/engine/base.py”,第1103行,在执行条款元素中
你的参数,
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/engine/base.py”,第1288行,在执行上下文中
e、 语句、参数、游标、上下文
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/engine/base.py”,第1482行,在_handle\u dbapi\u exception中
sqlalchemy\u异常,带有\u traceback=exc\u info[2],来自\uE=
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/util/compat.py”,第178行,在raise中_
引发异常
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/engine/base.py”,第1248行,在执行上下文中
游标、语句、参数、上下文
文件“/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site packages/sqlalchemy/engine/default.py”,第588行,在do_execute中
cursor.execute(语句、参数)
sqlalchemy.exc.OperationalError:(sqlite3.OperationalError)没有这样的表:job
[SQL:在作业(dag_id、状态、作业类型、开始日期、结束日期、最新检测信号、执行器类、主机名、unixname)中插入值(?,,,,,,,,,?)]
[参数:(无、'running'、'SchedulerJob'、'2020-12-10 23:11:18.838822'、无、'2020-12-10 23:11:18.838839'、'SequentialExecutor'、'ip-192-168-0-53.us-west-2.compute.internal'、'user1')]
(有关此错误的背景信息,请访问:http://sqlalche.me/e/e3q8)
我试图降级到sqlalchemy的旧版本,但仍然存在相同的问题。我目前使用的版本是:1.3.15
$initdb
还应检查是否设置了气流原点。
如果initdb不工作:
尝试使用airflow resetdb,但在此之前,如果您有任何数据,请从airflow主目录备份DAGS文件夹。谢谢,我需要取消设置airflow主目录并重置。