Python 使用pool和map的多处理问题
我想通过在python中使用pool和map函数获得输出,如下所示: **以随机顺序输出: PoolWorker-10输出:[0,4,8,12,16,20] PoolWorker-11输出:[0,4,8,12,16,20] PoolWorker-12输出:[0,4,8,12,16,20] PoolWorker-1输出:[0,4,8,12,16,20] ………** 我曾多次尝试将输出结果和当前_进程名称一起写入行中,但都失败了。我不知道应该改变哪一个以获得像上面那样的打印输出Python 使用pool和map的多处理问题,python,operating-system,multiprocessing,pool,Python,Operating System,Multiprocessing,Pool,我想通过在python中使用pool和map函数获得输出,如下所示: **以随机顺序输出: PoolWorker-10输出:[0,4,8,12,16,20] PoolWorker-11输出:[0,4,8,12,16,20] PoolWorker-12输出:[0,4,8,12,16,20] PoolWorker-1输出:[0,4,8,12,16,20] ………** 我曾多次尝试将输出结果和当前_进程名称一起写入行中,但都失败了。我不知道应该改变哪一个以获得像上面那样的打印输出 from multi
from multiprocessing import Pool, current_process
def multiprocessing_func():
input_list = [0, 1, 2, 3, 4, 5]
print("input list: {}".format(input_list))
print("Output in random order: ")
pool = Pool(10, current_process_func)
result = pool.map(calculate, input_list)
print(result)
pool.close()
pool.join()
def calculate(y_list):
return y_list * 4
def current_process_func():
print("{} output: ".format(current_process().name))
if __name__ == '__main__':
multiprocessing_func()
当我运行它时,我得到如下结果: 以随机顺序输出: PoolWorker-1输出: PoolWorker-2输出: PoolWorker-3输出: PoolWorker-4输出: PoolWorker-5输出: PoolWorker-7输出: PoolWorker-6输出: [0,4,8,12,16,20] PoolWorker-8输出: PoolWorker-9输出: PoolWorker-10输出:
我应该改变什么来获得我想要的结果 更改了您的代码片段,如下所示。整体考虑如下:
数据应理解为要分布在cpu池中的数据(也是此进程的专用数据)。此外,至少应该有尽可能多的项目和流程,以充分利用池。(我刚刚在那里列出了10个相同的列表)pool.map(func,data)
- 跳过了
构造中的初始化参数,以便在计算完成后仅输出所需的数据Pool()
from multiprocessing import Pool, current_process def multiprocessing_func(): input_list = [0, 1, 2, 3, 4, 5] print("input list: {}".format(input_list)) print("Output in random order: ") pool = Pool(10) result = pool.map(calculate, [input_list]*10) print() print("collected:" , result) pool.close() pool.join() def calculate(y_list): out = [x*4 for x in y_list] current_process_func(out) return out def current_process_func(data): print("{} output: {}".format(current_process().name, data)) if __name__ == '__main__': multiprocessing_func()
input list: [0, 1, 2, 3, 4, 5]
Output in random order:
ForkPoolWorker-52 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-55 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-57 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-51 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-53 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-54 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-56 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-58 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-60 output: [0, 4, 8, 12, 16, 20]
ForkPoolWorker-59 output: [0, 4, 8, 12, 16, 20]
collected: [[0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20], [0, 4, 8, 12, 16, 20]]
这是你期望的吗