Python 分布式计算反序列化错误

Python 分布式计算反序列化错误,python,scikit-learn,dask,dask-distributed,Python,Scikit Learn,Dask,Dask Distributed,我有一个dask调度程序和工作程序在linux机器上运行,我试图从Windows10笔记本电脑发送一个网格搜索任务 from dask.distributed import Client, progress client = Client('10.133.20.17:8786',processes=False,threads_per_worker=4,n_workers=1, memory_limit='2GB') from sklearn.datasets import make_classi

我有一个dask调度程序和工作程序在linux机器上运行,我试图从Windows10笔记本电脑发送一个网格搜索任务

from dask.distributed import Client, progress
client = Client('10.133.20.17:8786',processes=False,threads_per_worker=4,n_workers=1, memory_limit='2GB')
from sklearn.datasets import make_classification
from sklearn.svm import SVC
from sklearn.externals import joblib
from sklearn.model_selection import GridSearchCV
import pandas as pd

param_grid = {"C": [0.001, 0.01, 0.1, 0.5, 1.0, 2.0, 5.0, 10.0],
          "kernel": ['rbf', 'poly', 'sigmoid'],
          "shrinking": [True, False]}

grid_search = GridSearchCV(SVC(gamma='auto', random_state=0, probability=True),
                       param_grid=param_grid,
                       return_train_score=False,
                       iid=True,
                       cv=3,
                       n_jobs=-1)

with joblib.parallel_backend('dask'):
    grid_search.fit(X, y)
我收到此错误distributed.protocol.core-严重-无法反序列化

Traceback (most recent call last):
   File "C:\Users\kselvam\SOFTS\anaconda3\lib\site-packages\distributed\protocol\core.py", line 132, in loads
value = _deserialize(head, fs, deserializers=deserializers)
   File "C:\Users\kselvam\SOFTS\anaconda3\lib\site-packages\distributed\protocol\serialize.py", line 183, in deserialize
dumps, loads, wants_context = families[name]
KeyError: None
tornado.application - ERROR - Exception in callback functools.partial(<function wrap.<locals>.null_wrapper at 0x0000027207EB7950>, <Future finished exception=CancelledError(['_fit_and_score-batch-a4f6fd8cd0354973bb6b49d7f1530390'])>)
回溯(最近一次呼叫最后一次):
文件“C:\Users\kselvam\SOFTS\anaconda3\lib\site packages\distributed\protocol\core.py”,第132行,在loads中
值=_反序列化(head、fs、反序列化器=反序列化器)
文件“C:\Users\kselvam\SOFTS\anaconda3\lib\site packages\distributed\protocol\serialize.py”,第183行,反序列化
转储、加载、删除上下文=族[名称]
KeyError:无
tornado.application-错误-回调functools.partial中出现异常(,)

我不明白为什么它不能反序列化。当我作为本地群集(Windows)启动调度程序时,一切都正常工作。操作系统中的更改是否会影响序列化过程?我在linux和windows上分别有相同版本的sklearn(0.21.3)、tornado(5.1.1)和dask(1.0.0)

我的第一个猜测是,您的软件在整个集群中并不统一。您可能希望使用以下内容验证您的软件环境:

client.get_versions(check=True)

我的第一个猜测是,您的软件在整个集群中并不统一。您可能希望使用以下内容验证您的软件环境:

client.get_versions(check=True)