关于dask和x27的进度报告;s集u指数
我试图在整个脚本周围包装一个进度指示器。但是,关于dask和x27的进度报告;s集u指数,dask,dask-distributed,Dask,Dask Distributed,我试图在整个脚本周围包装一个进度指示器。但是,set_index(…,compute=False)仍然在调度程序上运行任务,可以在web界面中看到 如何报告set\u index步骤的进度 import dask.dataframe as dd from dask.distributed import Client, progress if __name__ == '__main__': with Client() as client: df = dd.read_csv('bi
set_index(…,compute=False)
仍然在调度程序上运行任务,可以在web界面中看到
如何报告set\u index
步骤的进度
import dask.dataframe as dd
from dask.distributed import Client, progress
if __name__ == '__main__':
with Client() as client:
df = dd.read_csv('big.csv')
# I can see on the web interface that something is happening.
# This blocks 20-30s on this particular CSV.
df = df.set_index('id', compute=False)
# Progress reporting works from here
out = client.compute(
df
)
progress(out)
# out.result()
# ...