Airflow 气流1.9-蒸发器不';好像不行?
升级到v1.9,我很难让Airflow 气流1.9-蒸发器不';好像不行?,airflow,Airflow,升级到v1.9,我很难让SSHOperator正常工作。它正在使用v1.8.2 代码 错误 [2018-02-19 06:48:02691]{{base_task_runner.py:98}}信息-子任务:回溯(最近一次调用最后一次): [2018-02-19 06:48:02691]{{base_task_runner.py:98}}信息-子任务:文件“/usr/bin/aiffort”,第27行,在 [2018-02-19 06:48:02692]{{base_task_runner.py:
SSHOperator
正常工作。它正在使用v1.8.2
代码
错误
[2018-02-19 06:48:02691]{{base_task_runner.py:98}}信息-子任务:回溯(最近一次调用最后一次):
[2018-02-19 06:48:02691]{{base_task_runner.py:98}}信息-子任务:文件“/usr/bin/aiffort”,第27行,在
[2018-02-19 06:48:02692]{{base_task_runner.py:98}信息-子任务:args.func(args)
[2018-02-19 06:48:02693]{{base_task_runner.py:98}信息-子任务:文件“/usr/lib/python2.7/site packages/aiffort/bin/cli.py”,第392行,运行中
[2018-02-19 06:48:02695]{{base_task_runner.py:98}}INFO-子任务:pool=args.pool,
[2018-02-19 06:48:02695]{{base_task_runner.py:98}信息-子任务:文件“/usr/lib/python2.7/site packages/aiffort/utils/db.py”,第50行,在包装器中
[2018-02-19 06:48:02696]{{base_task_runner.py:98}}信息-子任务:result=func(*args,**kwargs)
[2018-02-19 06:48:02696]{{base_task_runner.py:98}信息-子任务:文件“/usr/lib/python2.7/site packages/aiffair/models.py”,第1496行,在_run_raw_task中
[2018-02-19 06:48:02696]{{base_task_runner.py:98}}信息-子任务:result=task_copy.execute(context=context)
[2018-02-19 06:48:02697]{{base_task_runner.py:98}信息-子任务:文件“/usr/lib/python2.7/site packages/aiffair/contrib/operators/ssh_operator.py”,执行中的第146行
[2018-02-19 06:48:02697]{{base_task_runner.py:98}}信息-子任务:引发AirflowException(“SSH运算符错误:{0}”。格式(str(e)))
[2018-02-19 06:48:02698]{{base_task_runner.py:98}}信息-子任务:aiffort.exceptions.aifflowerexception:SSH运算符错误:“bool”对象没有属性“lower”
在检查连接设置时,使用字符串而不是bool确保额外的值SSH运算符已被重新处理:@FokkoDriesprong是的,但看起来他已将调用签名更改为匹配SSHOperator
例如:{“key\u file”:/Users/XXX/.SSH/XXX”,“no\u host\u key\u check”:“true”}
dag = DAG('transfer_ftp_s3', default_args=default_args,schedule_interval=None)
task = SSHOperator(
ssh_conn_id='ssh_node',
task_id="check_ftp_for_new_files",
command="echo 'hello world'",
do_xcom_push=True,
dag=dag,)
[2018-02-19 06:48:02,691] {{base_task_runner.py:98}} INFO - Subtask: Traceback (most recent call last):
[2018-02-19 06:48:02,691] {{base_task_runner.py:98}} INFO - Subtask: File "/usr/bin/airflow", line 27, in <module>
[2018-02-19 06:48:02,692] {{base_task_runner.py:98}} INFO - Subtask: args.func(args)
[2018-02-19 06:48:02,693] {{base_task_runner.py:98}} INFO - Subtask: File "/usr/lib/python2.7/site-packages/airflow/bin/cli.py", line 392, in run
[2018-02-19 06:48:02,695] {{base_task_runner.py:98}} INFO - Subtask: pool=args.pool,
[2018-02-19 06:48:02,695] {{base_task_runner.py:98}} INFO - Subtask: File "/usr/lib/python2.7/site-packages/airflow/utils/db.py", line 50, in wrapper
[2018-02-19 06:48:02,696] {{base_task_runner.py:98}} INFO - Subtask: result = func(*args, **kwargs)
[2018-02-19 06:48:02,696] {{base_task_runner.py:98}} INFO - Subtask: File "/usr/lib/python2.7/site-packages/airflow/models.py", line 1496, in _run_raw_task
[2018-02-19 06:48:02,696] {{base_task_runner.py:98}} INFO - Subtask: result = task_copy.execute(context=context)
[2018-02-19 06:48:02,697] {{base_task_runner.py:98}} INFO - Subtask: File "/usr/lib/python2.7/site-packages/airflow/contrib/operators/ssh_operator.py", line 146, in execute
[2018-02-19 06:48:02,697] {{base_task_runner.py:98}} INFO - Subtask: raise AirflowException("SSH operator error: {0}".format(str(e)))
[2018-02-19 06:48:02,698] {{base_task_runner.py:98}} INFO - Subtask: airflow.exceptions.AirflowException: SSH operator error: 'bool' object has no attribute 'lower'