Scala 为什么StreamingContext.socketTextStream会给出;错误scheduler.ReceiverTracker:为流0取消注册的接收器;?
为什么下面的代码会失败Scala 为什么StreamingContext.socketTextStream会给出;错误scheduler.ReceiverTracker:为流0取消注册的接收器;?,scala,apache-spark,spark-streaming,Scala,Apache Spark,Spark Streaming,为什么下面的代码会失败 import org.apache.spark.streaming._ val ssc = new StreamingContext(sc, Seconds(2)) val lStream = ssc.socketTextStream("127.0.0.1", 7777) val words = lStream.flatMap(x => x.split(" ")).countByValue() words.print() ssc.start() 低于误差
import org.apache.spark.streaming._
val ssc = new StreamingContext(sc, Seconds(2))
val lStream = ssc.socketTextStream("127.0.0.1", 7777)
val words = lStream.flatMap(x => x.split(" ")).countByValue()
words.print()
ssc.start()
低于误差
17/07/27 17:34:08 ERROR scheduler.ReceiverTracker: Deregistered receiver for stream 0: Restarting receiver with delay 2000ms:
Error connecting to 127.0.0.1:7777 - java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at java.net.Socket.<init>(Socket.java:425)
at java.net.Socket.<init>(Socket.java:208)
at org.apache.spark.streaming.dstream.SocketReceiver.receive(SocketInputDStream.scala:73)
at org.apache.spark.streaming.dstream.SocketReceiver$$anon$2.run(SocketInputDStream.scala:59)
17/07/27 17:34:08错误调度程序。ReceiverTracker:取消注册流0的接收器:以延迟2000ms重新启动接收器:
连接到127.0.0.1:7777时出错-java.net.ConnectException:连接被拒绝
位于java.net.PlainSocketImpl.socketConnect(本机方法)
位于java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
位于java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
位于java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
位于java.net.socksocketimpl.connect(socksocketimpl.java:392)
位于java.net.Socket.connect(Socket.java:579)
位于java.net.Socket.connect(Socket.java:528)
位于java.net.Socket。(Socket.java:425)
位于java.net.Socket(Socket.java:208)
位于org.apache.spark.streaming.dstream.SocketReceiver.receive(SocketInputDStream.scala:73)
位于org.apache.spark.streaming.dstream.SocketReceiver$$anon$2.run(SocketInputDStream.scala:59)
错误消息是因为没有应用程序侦听127.0.0.1
上的7777
端口
您可以使用这个实用程序来创建一个,但这仅仅是为了演示的目的。使用以下命令启动一个会话(为您使用的每个操作系统选择一个会话)
请参阅Spark文档中的
// OpenBSD / macOS
nc -lk 7777
// other OSes
nc -lk -p 7777