Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/shell/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Python SSH分发进程大文件不稳定_Python_Shell_Ssh_Mapreduce_Nohup - Fatal编程技术网

Python SSH分发进程大文件不稳定

Python SSH分发进程大文件不稳定,python,shell,ssh,mapreduce,nohup,Python,Shell,Ssh,Mapreduce,Nohup,我正在处理一个大文件,我正在使用ssh登录到每个节点以完成我想要的任务。我登录到其中一个节点并在那里触发 nohup ssh root@nodes717"cat /nsf/share/input_file_aa | python /nsf/share/process.py" > output_aa & nohup ssh root@nodes716"cat /nsf/share/input_file_ab | python /nsf/share/process.py" > o

我正在处理一个大文件,我正在使用ssh登录到每个节点以完成我想要的任务。我登录到其中一个节点并在那里触发

nohup ssh root@nodes717"cat /nsf/share/input_file_aa | python /nsf/share/process.py" > output_aa &
nohup ssh root@nodes716"cat /nsf/share/input_file_ab | python /nsf/share/process.py" > output_ab &
nohup ssh root@nodes715"cat /nsf/share/input_file_ac | python /nsf/share/process.py" > output_ac &
nohup ssh root@nodes714"cat /nsf/share/input_file_ad | python /nsf/share/process.py" > output_ad &
nohup ssh root@nodes713"cat /nsf/share/input_file_ae | python /nsf/share/process.py" > output_ae &
nohup ssh root@nodes712"cat /nsf/share/input_file_af | python /nsf/share/process.py" > output_af &
nohup ssh root@nodes711"cat /nsf/share/input_file_ag | python /nsf/share/process.py" > output_ag &
nohup ssh root@nodes710"cat /nsf/share/input_file_ah | python /nsf/share/process.py" > output_ah &
nohup ssh root@nodes709"cat /nsf/share/input_file_ai | python /nsf/share/process.py" > output_ai &
nohup ssh root@nodes708"cat /nsf/share/input_file_aj | python /nsf/share/process.py" > output_aj &
nohup ssh root@nodes707"cat /nsf/share/input_file_ak | python /nsf/share/process.py" > output_ak &
nohup ssh root@nodes706"cat /nsf/share/input_file_al | python /nsf/share/process.py" > output_al &
nohup ssh root@nodes705"cat /nsf/share/input_file_am | python /nsf/share/process.py" > output_am &
nohup ssh root@nodes704"cat /nsf/share/input_file_an | python /nsf/share/process.py" > output_an &

然而,我可以完成大部分工作,但我经常会在几分钟后退出两三个nohup工作。(失败)。我想知道导致这个错误的可能原因是什么?ssh通道太多或只是“ssh映射减少”的错误

是否将所有进程的std err重定向到公共文件<代码>nohup ssh…>输出2>>stdErr&?祝你好运。很高兴知道这一点。谢了,谢了