Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/python/288.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Python 气流列表\u dag未使用变量标识dag_Python_Airflow - Fatal编程技术网

Python 气流列表\u dag未使用变量标识dag

Python 气流列表\u dag未使用变量标识dag,python,airflow,Python,Airflow,我正在尝试运行气流列表\u dags,我得到: [2020-11-12 09:42:09,617] {{__init__.py:51}} INFO - Using executor SequentialExecutor [2020-11-12 09:42:09,618] {{dagbag.py:403}} INFO - Filling up the DagBag from /usr/local/airflow/dags [2020-11-12 09:42:09,692] {{dagbag.py:

我正在尝试运行
气流列表\u dags
,我得到:

[2020-11-12 09:42:09,617] {{__init__.py:51}} INFO - Using executor SequentialExecutor
[2020-11-12 09:42:09,618] {{dagbag.py:403}} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2020-11-12 09:42:09,692] {{dagbag.py:246}} ERROR - Failed to import: /usr/local/airflow/dags/my-dag/my_dag.py
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1248, in _execute_context
    cursor, statement, parameters, context
  File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/default.py", line 588, in do_execute
    cursor.execute(statement, parameters)
sqlite3.OperationalError: no such table: variable

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airflow/models/dagbag.py", line 243, in process_file
    m = imp.load_source(mod_name, filepath)
  File "/usr/local/lib/python3.7/imp.py", line 171, in load_source
    module = _load(spec)
  File "<frozen importlib._bootstrap>", line 696, in _load
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/usr/local/airflow/dags/my-dag/my_dag.py", line 22, in <module>
    my_conf = Variable.get("my_conf", deserialize_json=True)
  File "/usr/local/lib/python3.7/site-packages/airflow/utils/db.py", line 74, in wrapper
    return func(*args, **kwargs)
[2020-11-12 09:42:09617]{{{{uuuu init_uuu.py:51}}信息-使用执行器顺序执行器
[2020-11-12 09:42:09618]{{dagbag.py:403}}信息-从/usr/local/aiffair/dags填充dagbag
[2020-11-12 09:42:09692]{{dagbag.py:246}错误-导入失败:/usr/local/aiffort/dags/my dag/my_dag.py
回溯(最近一次呼叫最后一次):
文件“/usr/local/lib/python3.7/site packages/sqlalchemy/engine/base.py”,第1248行,在执行上下文中
游标、语句、参数、上下文
文件“/usr/local/lib/python3.7/site packages/sqlalchemy/engine/default.py”,第588行,在do_execute中
cursor.execute(语句、参数)
sqlite3.ERROR:没有这样的表:变量
上述异常是以下异常的直接原因:
回溯(最近一次呼叫最后一次):
文件“/usr/local/lib/python3.7/site packages/afflow/models/dagbag.py”,第243行,进程文件中
m=imp.load\u源(模块名称、文件路径)
文件“/usr/local/lib/python3.7/imp.py”,第171行,在load_source中
模块=_负载(规格)
文件“”,第696行,正在加载
文件“”,第677行,在\u加载\u解锁
exec_模块中第728行的文件“”
文件“”,第219行,在“调用”中,删除了“帧”
文件“/usr/local/afflow/dags/my dag/my_dag.py”,第22行,in
my_conf=Variable.get(“my_conf”,反序列化_json=True)
文件“/usr/local/lib/python3.7/site packages/afflow/utils/db.py”,第74行,在包装器中
返回函数(*args,**kwargs)

我知道气流无法识别变量
my_conf
。如何从airflow cli设置此变量?或者,即使存在未设置的变量,如何使
气流列表
工作?如果变量是从ui设置的,我也有同样的问题。

不确定这是否能解决您的问题,因为错误似乎表明存在不同的问题,但要回答您的具体问题:

airflow variables -s my_conf some_value

这可以在中找到。

您能提供DAG的代码吗?否则,很难给出任何有用的建议。