Python dask分布式客户机中的导入错误
过去几个月,我们一直在使用分布在计算集群上的dask。最近我们升级了所有python包,现在所有dask客户机似乎都出现以下错误:Python dask分布式客户机中的导入错误,python,distributed,dask,Python,Distributed,Dask,过去几个月,我们一直在使用分布在计算集群上的dask。最近我们升级了所有python包,现在所有dask客户机似乎都出现以下错误: distributed.nanny - INFO - Start Nanny at: 'tcp://10.38.37.14:40983' Traceback (most recent call last): File "PYTHON_INSTALL_DIR/lib/python3.6/multiprocessing/forkserver.py", l
distributed.nanny - INFO - Start Nanny at: 'tcp://10.38.37.14:40983'
Traceback (most recent call last):
File "PYTHON_INSTALL_DIR/lib/python3.6/multiprocessing/forkserver.py", line
178, in main
_serve_one(s, listener, alive _r, handler)
File "PYTHON_INSTALL_DIR/lib/python3.6/multiprocessing/forkserver.py", line 212, in _serve_one
code = spawn._main(child_r)
File "PYTHON_INSTALL_DIR/lib/python3.6/multiprocessing/spawn.py", line 115,
in _main
self = reduction.pickle.load(from_parent)
ModuleNotFoundError: No module named 'distributed.http'
distributed.nanny - WARNING - Worker process 8566 was killed by unknown signal
distributed.nanny - WARNING - Restarting worker
知道是什么导致了这个问题吗?
仅供参考,以下版本的dask相关软件包出现此错误:
谢谢分发。http在最近的版本中确实被删除了。 您收到此错误表明您的安装中存在不兼容的版本,或者您的路径以某种方式变得混乱。您可以检查诸如
$PATH
,哪个python
,哪个dask worker
,python-c'导入系统;打印(系统路径)
,依此类推
我建议安装到一个新的虚拟或康达环境(我个人更喜欢康达)