Airflow 气流（Google Composer）类型错误：can'；t pickle\u thread.RLock对象
我正在使用airflow（Google composer），但在下面遇到了一些例外 TypeError:无法pickle\u thread.RLock对象Airflow 气流（Google Composer）类型错误：can'；t pickle\u thread.RLock对象,airflow,airflow-scheduler,google-cloud-composer,Airflow,Airflow Scheduler,Google Cloud Composer,我正在使用airflow（Google composer），但在下面遇到了一些例外 TypeError:无法pickle\u thread.RLock对象 Ooops. ____/ ( ( ) ) \___ /( ( ( ) _ )) ) )\ (( ( )( ) ) ( ) )
Ooops.
____/ ( ( ) ) \___
/( ( ( ) _ )) ) )\
(( ( )( ) ) ( ) )
((/ ( _( ) ( _) ) ( () ) )
( ( ( (_) (( ( ) .((_ ) . )_
( ( ) ( ( ) ) ) . ) ( )
( ( ( ( ) ( _ ( _) ). ) . ) ) ( )
( ( ( ) ( ) ( )) ) _)( ) ) )
( ( ( \ ) ( (_ ( ) ( ) ) ) ) )) ( )
( ( ( ( (_ ( ) ( _ ) ) ( ) ) )
( ( ( ( ( ) (_ ) ) ) _) ) _( ( )
(( ( )( ( _ ) _) _(_ ( (_ )
(_((__(_(__(( ( ( | ) ) ) )_))__))_)___)
((__) \\||lll|l||/// \_))
( /(/ ( ) ) )\ )
( ( ( ( | | ) ) )\ )
( /(| / ( )) ) ) )) )
( ( ((((_(|)_))))) )
( ||\(|(|)|/|| )
( |(||(||)|||| )
( //|/l|||)|\\ \ )
(/ / // /|//||||\\ \ \ \ _)
-------------------------------------------------------------------------------
Node: d93e048dc08a
-------------------------------------------------------------------------------
Traceback (most recent call last):
File "/opt/python3.6/lib/python3.6/site-packages/flask/app.py", line 2447, in wsgi_app
response = self.full_dispatch_request()
File "/opt/python3.6/lib/python3.6/site-packages/flask/app.py", line 1952, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/opt/python3.6/lib/python3.6/site-packages/flask/app.py", line 1821, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/opt/python3.6/lib/python3.6/site-packages/flask/_compat.py", line 39, in reraise
raise value
File "/opt/python3.6/lib/python3.6/site-packages/flask/app.py", line 1950, in full_dispatch_request
rv = self.dispatch_request()
File "/opt/python3.6/lib/python3.6/site-packages/flask/app.py", line 1936, in dispatch_request
return self.view_functions[rule.endpoint](**req.view_args)
File "/opt/python3.6/lib/python3.6/site-packages/flask_admin/base.py", line 69, in inner
return self._run_view(f, *args, **kwargs)
File "/opt/python3.6/lib/python3.6/site-packages/flask_admin/base.py", line 368, in _run_view
return fn(self, *args, **kwargs)
File "/opt/python3.6/lib/python3.6/site-packages/flask_login/utils.py", line 258, in decorated_view
return func(*args, **kwargs)
File "/usr/local/lib/airflow/airflow/www/utils.py", line 290, in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/airflow/airflow/www/utils.py", line 337, in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/airflow/airflow/www/views.py", line 1335, in clear
include_upstream=upstream)
File "/usr/local/lib/airflow/airflow/models/dag.py", line 1243, in sub_dag
for t in regex_match + also_include}
File "/usr/local/lib/airflow/airflow/models/dag.py", line 1243, in <dictcomp>
for t in regex_match + also_include}
File "/opt/python3.6/lib/python3.6/copy.py", line 161, in deepcopy
y = copier(memo)
File "/usr/local/lib/airflow/airflow/models/baseoperator.py", line 678, in __deepcopy__
setattr(result, k, copy.deepcopy(v, memo))
File "/opt/python3.6/lib/python3.6/copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "/opt/python3.6/lib/python3.6/copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 150, in deepcopy
y = copier(x, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "/opt/python3.6/lib/python3.6/copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 150, in deepcopy
y = copier(x, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "/opt/python3.6/lib/python3.6/copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 150, in deepcopy
y = copier(x, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 150, in deepcopy
y = copier(x, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 215, in _deepcopy_list
append(deepcopy(a, memo))
File "/opt/python3.6/lib/python3.6/copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "/opt/python3.6/lib/python3.6/copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 150, in deepcopy
y = copier(x, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/opt/python3.6/lib/python3.6/copy.py", line 169, in deepcopy
rv = reductor(4)
TypeError: can't pickle _thread.RLock objects
oops。
____/ ( ( ) ) \___
/( ( ( ) _ )) ) )\
(( ( )( ) ) ( ) )
((/ ( _( ) ( _) ) ( () ) )
( ( ( (_) (( ( ) .((_ ) . )_
( ( ) ( ( ) ) ) . ) ( )
( ( ( ( ) ( _ ( _) ). ) . ) ) ( )
( ( ( ) ( ) ( )) ) _)( ) ) )
( ( ( \ ) ( (_ ( ) ( ) ) ) ) )) ( )
( ( ( ( (_ ( ) ( _ ) ) ( ) ) )
( ( ( ( ( ) (_ ) ) ) _) ) _( ( )
(( ( )( ( _ ) _) _(_ ( (_ )
(_((__(_(__(( ( ( | ) ) ) )_))__))_)___)
（（| | lll | l | |//|））
( /(/ ( ) ) )\ )
( ( ( ( | | ) ) )\ )
( /(| / ( )) ) ) )) )
( ( ((((_(|)_))))) )
( ||\(|(|)|/|| )
( |(||(||)|||| )
（//|/l | | | |）\\）
(/ / // /|//||||\\ \ \ \ _)
-------------------------------------------------------------------------------
节点：d93e048dc08a
-------------------------------------------------------------------------------
回溯（最近一次呼叫最后一次）：
wsgi_应用程序中的文件“/opt/python3.6/lib/python3.6/site packages/flask/app.py”，第2447行
response=self.full\u dispatch\u request（）
文件“/opt/python3.6/lib/python3.6/site packages/flask/app.py”，第1952行，完整发送请求
rv=自身处理用户异常（e）
文件“/opt/python3.6/lib/python3.6/site packages/flask/app.py”，第1821行，在handle\u user\u异常中
重放（exc_类型、exc_值、tb）
文件“/opt/python3.6/lib/python3.6/site-packages/flask/_-compat.py”，第39行，重新登录
增值
文件“/opt/python3.6/lib/python3.6/site packages/flask/app.py”，第1950行，完整发送请求
rv=自我分派请求（）
文件“/opt/python3.6/lib/python3.6/site packages/flask/app.py”，第1936行，在调度请求中
返回self.view_函数[rule.endpoint]（**req.view_参数）
文件“/opt/python3.6/lib/python3.6/site packages/flask_admin/base.py”，第69行，在内部
返回自我。运行视图（f，*args，**kwargs）
文件“/opt/python3.6/lib/python3.6/site packages/flask\u admin/base.py”，第368行，在运行视图中
返回fn（自身、*args、**kwargs）
文件“/opt/python3.6/lib/python3.6/site packages/flask\u login/utils.py”，第258行，在装饰视图中
返回函数（*args，**kwargs）
文件“/usr/local/lib/afflow/afflow/www/utils.py”，第290行，包装中
返回f（*args，**kwargs）
文件“/usr/local/lib/afflow/afflow/www/utils.py”，第337行，在包装器中
返回f（*args，**kwargs）
文件“/usr/local/lib/afflow/afflow/www/views.py”，第1335行，清晰显示
包括（上游=上游）
文件“/usr/local/lib/aiffair/aiffair/models/dag.py”，第1243行，sub_dag
对于正则表达式中的t，匹配+也包括}
文件“/usr/local/lib/afflow/afflow/models/dag.py”，第1243行，在
对于正则表达式中的t，匹配+也包括}
文件“/opt/python3.6/lib/python3.6/copy.py”，第161行，在deepcopy中
y=复印机（备忘录）
文件“/usr/local/lib/afflow/afflow/models/baseoperator.py”，第678行，在__
setattr（结果，k，副本。深度副本（v，备忘录））
文件“/opt/python3.6/lib/python3.6/copy.py”，第180行，在deepcopy中
y=_（x，备忘录，*rv）
文件“/opt/python3.6/lib/python3.6/copy.py”，第280行，在
状态=深度复制（状态，备忘录）
文件“/opt/python3.6/lib/python3.6/copy.py”，第150行，在deepcopy中
y=复印机（x，备忘）
文件“/opt/python3.6/lib/python3.6/copy.py”，第240行，在dict中
y[deepcopy（key，memo）]=deepcopy（value，memo）
文件“/opt/python3.6/lib/python3.6/copy.py”，第180行，在deepcopy中
y=_（x，备忘录，*rv）
文件“/opt/python3.6/lib/python3.6/copy.py”，第280行，在
状态=深度复制（状态，备忘录）
文件“/opt/python3.6/lib/python3.6/copy.py”，第150行，在deepcopy中
y=复印机（x，备忘）
文件“/opt/python3.6/lib/python3.6/copy.py”，第240行，在dict中
y[deepcopy（key，memo）]=deepcopy（value，memo）
文件“/opt/python3.6/lib/python3.6/copy.py”，第180行，在deepcopy中
y=_（x，备忘录，*rv）
文件“/opt/python3.6/lib/python3.6/copy.py”，第280行，在
状态=深度复制（状态，备忘录）
文件“/opt/python3.6/lib/python3.6/copy.py”，第150行，在deepcopy中
y=复印机（x，备忘）
文件“/opt/python3.6/lib/python3.6/copy.py”，第240行，在dict中
y[deepcopy（key，memo）]=deepcopy（value，memo）
文件“/opt/python3.6/lib/python3.6/copy.py”，第150行，在deepcopy中
y=复印机（x，备忘）
文件“/opt/python3.6/lib/python3.6/copy.py”，第215行，在深度复制列表中
附加（副本（a、备忘录））
文件“/opt/python3.6/lib/python3.6/copy.py”，第180行，在deepcopy中
y=_（x，备忘录，*rv）
文件“/opt/python3.6/lib/python3.6/copy.py”，第280行，在
状态=深度复制（状态，备忘录）
文件“/opt/python3.6/lib/python3.6/copy.py”，第150行，在deepcopy中
y=复印机（x，备忘）
文件“/opt/python3.6/lib/python3.6/copy.py”，第240行，在dict中
y[deepcopy（key，memo）]=deepcopy（value，memo）
文件“/opt/python3.6/lib/python3.6/copy.py”，第169行，在deepcopy中
rv=减速器（4）
TypeError:无法pickle\u thread.RLock对象
kubectl -it exec $(kubectl get po -l run=airflow-worker -o jsonpath='{.items[0].metadata.name}' \
-n $(kubectl get ns| grep composer*| awk '{print $1}')) -n $(kubectl get ns| grep composer*| awk '{print $1}') \
-c airflow-worker -- mysql -u root -h airflow-sqlproxy-service.default
mysql> show databases;
+-----------------------------------------+
| Database |
+-----------------------------------------+
| information_schema |
| composer-1-11-3-airflow-1-10-6-* |
| mysql |
| performance_schema |
| sys |
+-----------------------------------------+
5 rows in set (0.01 sec)
delete from task_instance where task_id='<task_id>' AND execution_date='<execution_date>'