Plugins 是否可以从python向分布式调度器安装插件?
我想从python安装daskmemusage插件。这在使用LocalCluster时起作用:Plugins 是否可以从python向分布式调度器安装插件?,plugins,dask,dask-distributed,Plugins,Dask,Dask Distributed,我想从python安装daskmemusage插件。这在使用LocalCluster时起作用: >>> from distributed import LocalCluster >>> l=LocalCluster() >>> l LocalCluster(956f529f, 'tcp://127.0.0.1:42496', workers=8, threads=64, memory=503.63 GiB) >>> l.sc
>>> from distributed import LocalCluster
>>> l=LocalCluster()
>>> l
LocalCluster(956f529f, 'tcp://127.0.0.1:42496', workers=8, threads=64, memory=503.63 GiB)
>>> l.scheduler
<Scheduler: "tcp://127.0.0.1:42496" processes: 8 cores: 64>
>>> import dask_memusage
>>> dask_memusage.install(l.scheduler, "mem.csv")
>>>
来自分布式导入LocalCluster的>
>>>l=LocalCluster()
>>>l
本地群集(956f529f,'tcp://127.0.0.1:42496',工作线程=8,线程=64,内存=503.63 GiB)
>>>调度程序
>>>导入dask_memusage
>>>dask_memusage.install(l.scheduler,“mem.csv”)
>>>
但是,通过SSHCluster执行等效操作不起作用:
from dask.distributed import Client, SSHCluster
...: import dask_memusage
...:
...: cluster = SSHCluster(
...: [
...: "openhpc-compute-0",
...: "openhpc-compute-1",
...: "openhpc-compute-2",
...: "openhpc-compute-3",
...: "openhpc-compute-4",
...: "openhpc-compute-5",
...: "openhpc-compute-6",
...: "openhpc-compute-7",
...: ],
...: connect_options={"known_hosts": None},
...: worker_options={"nthreads": 1},
...: scheduler_options={"port": 0, "dashboard_address": ":8797"},
...: )
cluster.scheduler
<SSH Scheduler: status=Status.running>
18 )
19 client = Client(cluster)
---> 20 dask_memusage.install(cluster.scheduler, "mem.csv")
~/miniconda3/envs/rascil37/lib/python3.7/site-packages/dask_memusage.py in install(scheduler, csv_path)
121 """
122 plugin = MemoryUsagePlugin(scheduler, csv_path)
--> 123 scheduler.add_plugin(plugin)
124
125
AttributeError: 'Scheduler' object has no attribute 'add_plugin'
来自dask.distributed import客户端,SSHCluster
…:导入dask_memusage
...:
…:cluster=SSHCluster(
...: [
…:“openhpc-compute-0”,
…:“openhpc-compute-1”,
…:“openhpc-compute-2”,
…:“openhpc-compute-3”,
…:“openhpc-compute-4”,
…:“openhpc-compute-5”,
…:“openhpc-compute-6”,
…:“openhpc-compute-7”,
...: ],
…:connect_options={“已知_主机”:None},
…:worker_options={“nthreads”:1},
…:调度程序_选项={“端口”:0,“仪表板_地址”:“:8797”},
...: )
群集调度程序
18 )
19客户端=客户端(群集)
--->20 dask_memusage.install(cluster.scheduler,“mem.csv”)
安装中的~/miniconda3/envs/rascil37/lib/python3.7/site-packages/dask_memusage.py(调度程序,csv_路径)
121 """
122 plugin=MemoryUsagePlugin(调度程序,csv_路径)
-->123调度程序。添加插件(插件)
124
125
AttributeError:“调度程序”对象没有属性“添加插件”
我知道这可以通过单独启动调度程序来实现,但我希望能够以编程方式设置csv_路径的名称,因为我正在对参数进行循环。我缺少什么
谢谢