Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark Pyspark冻结在客户机模式下,使用纱线群集管理器_Apache Spark_Pyspark - Fatal编程技术网

Apache spark Pyspark冻结在客户机模式下,使用纱线群集管理器

Apache spark Pyspark冻结在客户机模式下,使用纱线群集管理器,apache-spark,pyspark,Apache Spark,Pyspark,按照这些说明:我设置了一个3节点集群,能够运行spark shell。但当我尝试运行pyspark时,我收到了以下消息: hadoop@master:~$ pyspark Python 3.7.1 (default, Dec 14 2018, 19:28:38) [GCC 7.3.0] :: Anaconda, Inc. on linux Type "help", "copyright", "credits" or "license" for more information. Settin

按照这些说明:我设置了一个3节点集群,能够运行spark shell。但当我尝试运行pyspark时,我收到了以下消息:

hadoop@master:~$ pyspark 
Python 3.7.1 (default, Dec 14 2018, 19:28:38) 
[GCC 7.3.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
19/02/15 21:51:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
19/02/15 21:51:06 WARN util.Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
19/02/15 21:51:12 WARN yarn.Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
屏幕冻结(没有其他消息)。 我不知道怎样才能解决这个问题

PS:正如链接中所解释的,我首先部署了一个3节点的hadoop纱线集群,然后在主节点上安装了spark(在启动warn-start.sh之后)