SparkException:Python工作程序未及时连接回
我正在尝试将Python作业提交给2个工作节点Spark群集,但始终发现以下问题,最终导致Spark提交失败:SparkException:Python工作程序未及时连接回,python,hadoop,apache-spark,yarn,pyspark,Python,Hadoop,Apache Spark,Yarn,Pyspark,我正在尝试将Python作业提交给2个工作节点Spark群集,但始终发现以下问题,最终导致Spark提交失败: 15/07/04 21:30:40 WARN scheduler.TaskSetManager: Lost task 0.1 in stage 0.0 (TID 2, workernode0.rhom-spark.b9.internal.cloudapp.net): org.apache.spark.SparkException: Python worker did not
15/07/04 21:30:40 WARN scheduler.TaskSetManager: Lost task 0.1 in stage 0.0 (TID
2, workernode0.rhom-spark.b9.internal.cloudapp.net):
org.apache.spark.SparkException: Python worker did not connect back in time
at org.apache.spark.api.python.PythonWorkerFactory.createSimpleWorker(PythonWorkerFactory.scala:135)
at org.apache.spark.api.python.PythonWorkerFactory.create(PythonWorkerFactory.scala:64)
at org.apache.spark.SparkEnv.createPythonWorker(SparkEnv.scala:102)
at org.apache.spark.api.python.PythonRDD.compute(PythonRDD.scala:70)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:278)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:245)
at org.apache.spark.api.python.PairwiseRDD.compute(PythonRDD.scala:305)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:278)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:245)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
at org.apache.spark.scheduler.Task.run(Task.scala:56)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:200)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Accept timed out
at java.net.DualStackPlainSocketImpl.waitForNewConnection(Native Method)
at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:135)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
at java.net.ServerSocket.implAccept(ServerSocket.java:530)
at java.net.ServerSocket.accept(ServerSocket.java:498)
at org.apache.spark.api.python.PythonWorkerFactory.createSimpleWorker(PythonWorkerFactory.scala:130)
... 15 more
我提交的工作与以下内容
spark-submit --master yarn --py-files tile.py --num-executors 1 --executor-memory 2g main.py
有什么想法吗?因此,当python工作进程无法连接到spark executor JVM时,就会发生这种情况。Spark使用套接字与辅助进程通信。出现这种情况的原因有很多,具体细节可能会在执行器/工作机器上的日志中。在哪里/如何访问执行器/工作机器上的日志?因为您使用的是Thread,所以我会专门查看“调试您的应用程序”部分。我不使用Thread,希望看到日志。我在哪里能找到它?