Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Scala 为什么StreamingContext.socketTextStream会给出;错误scheduler.ReceiverTracker:为流0取消注册的接收器;?_Scala_Apache Spark_Spark Streaming - Fatal编程技术网

Scala 为什么StreamingContext.socketTextStream会给出;错误scheduler.ReceiverTracker:为流0取消注册的接收器;?

Scala 为什么StreamingContext.socketTextStream会给出;错误scheduler.ReceiverTracker:为流0取消注册的接收器;?,scala,apache-spark,spark-streaming,Scala,Apache Spark,Spark Streaming,为什么下面的代码会失败 import org.apache.spark.streaming._ val ssc = new StreamingContext(sc, Seconds(2)) val lStream = ssc.socketTextStream("127.0.0.1", 7777) val words = lStream.flatMap(x => x.split(" ")).countByValue() words.print() ssc.start() 低于误差

为什么下面的代码会失败

import org.apache.spark.streaming._

val ssc = new StreamingContext(sc, Seconds(2))

val lStream = ssc.socketTextStream("127.0.0.1", 7777)

val words = lStream.flatMap(x => x.split(" ")).countByValue()

words.print()

ssc.start()
低于误差

17/07/27 17:34:08 ERROR scheduler.ReceiverTracker: Deregistered receiver for stream 0: Restarting receiver with delay 2000ms:
Error connecting to 127.0.0.1:7777 - java.net.ConnectException: Connection refused                                              
        at java.net.PlainSocketImpl.socketConnect(Native Method)                                                               
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)                                        
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)                                 
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)                                          
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)                                                          
        at java.net.Socket.connect(Socket.java:579)                                                                            
        at java.net.Socket.connect(Socket.java:528)                                                                            
        at java.net.Socket.<init>(Socket.java:425)                                                                             
        at java.net.Socket.<init>(Socket.java:208)                                                                             
        at org.apache.spark.streaming.dstream.SocketReceiver.receive(SocketInputDStream.scala:73)                              
        at org.apache.spark.streaming.dstream.SocketReceiver$$anon$2.run(SocketInputDStream.scala:59)  
17/07/27 17:34:08错误调度程序。ReceiverTracker:取消注册流0的接收器:以延迟2000ms重新启动接收器:
连接到127.0.0.1:7777时出错-java.net.ConnectException:连接被拒绝
位于java.net.PlainSocketImpl.socketConnect(本机方法)
位于java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
位于java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
位于java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
位于java.net.socksocketimpl.connect(socksocketimpl.java:392)
位于java.net.Socket.connect(Socket.java:579)
位于java.net.Socket.connect(Socket.java:528)
位于java.net.Socket。(Socket.java:425)
位于java.net.Socket(Socket.java:208)
位于org.apache.spark.streaming.dstream.SocketReceiver.receive(SocketInputDStream.scala:73)
位于org.apache.spark.streaming.dstream.SocketReceiver$$anon$2.run(SocketInputDStream.scala:59)

错误消息是因为没有应用程序侦听
127.0.0.1
上的
7777
端口

您可以使用这个实用程序来创建一个,但这仅仅是为了演示的目的。使用以下命令启动一个会话(为您使用的每个操作系统选择一个会话)

请参阅Spark文档中的

// OpenBSD / macOS
nc -lk 7777

// other OSes
nc -lk -p 7777