Python 带附加到列表的dask

Python 带附加到列表的dask,python,dask,dask-distributed,dask-delayed,Python,Dask,Dask Distributed,Dask Delayed,有关 我有一个子任务,在该子任务中,我为一个值列表调用一个expernal api,并为每个调用返回一个元组: ### This section should be daskified accs = [...] # list of account numbers out= [] for acc in accs: out.append(call_to_external(acc)) ### outbag = bag.from_sequence(out, num_partition=10)

有关 我有一个子任务,在该子任务中,我为一个值列表调用一个expernal api,并为每个调用返回一个元组:

### This section should be daskified
accs = [...] # list of account numbers
out= []
for acc in accs:
   out.append(call_to_external(acc))
### 
outbag = bag.from_sequence(out, num_partition=10)
所以最后它变成了一个袋子。问题是,
out
太大了。所以我想把它转储到磁盘上,理想情况下是在几个文件中,然后读入一个包中,这样负载就可以分布到几个工人身上

正如最初的声明所说,这一切都发生在dask延迟调用中,以防万一