Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark 从远程参与者向Spark actorStream发送消息时,连接始终断开_Apache Spark_Akka_Spark Streaming_Akka Remote Actor - Fatal编程技术网

Apache spark 从远程参与者向Spark actorStream发送消息时,连接始终断开

Apache spark 从远程参与者向Spark actorStream发送消息时,连接始终断开,apache-spark,akka,spark-streaming,akka-remote-actor,Apache Spark,Akka,Spark Streaming,Akka Remote Actor,当从远程参与者向spark发送消息时,心跳将始终失败: 远程节点上的日志: [信息][03/23/2015 22:13:33.591][wtb akka.remote.default-remote-dispatcher-6][akka。tcp://wtb@127.0.0.1:2552/system/transports/akkaprotocolmanager.tcp0/akkaProtocol tcp%3A%2F%2FsparkDriver%40127.0.0.1%3A7777-1]远程无响应。

当从远程参与者向spark发送消息时,心跳将始终失败:

远程节点上的日志:

[信息][03/23/2015 22:13:33.591][wtb akka.remote.default-remote-dispatcher-6][akka。tcp://wtb@127.0.0.1:2552/system/transports/akkaprotocolmanager.tcp0/akkaProtocol tcp%3A%2F%2FsparkDriver%40127.0.0.1%3A7777-1]远程无响应。握手超时或触发传输故障检测器

[警告][03/23/2015 22:13:33.605][wtb akka.remote.default-remote-dispatcher-5][akka。tcp://wtb@127.0.0.1:2552/system/endpointManager/reliableEndpointWriter akka.tcp%3A%2F%2FParkDriver%40127.0.0.1%3A7777-0]与远程系统[akka]的关联。tcp://sparkDriver@127.0.0.1:7777]失败,地址现在为[5000]毫秒。原因是:[解除关联]

Spark节点上的日志:

15/03/23 22:13:33警告可靠交付主管:与远程系统关联[akka。tcp://wtb@127.0.0.1:2552]已失败,地址现在已为[5000]毫秒选通。原因是:[已解除关联]


我错过了什么导致了这些错误?

默认情况下,Spark禁用Akka心跳。它设置为1000秒。设置心跳间隔可修复此问题