Apache storm 工人与ZK断开长运行螺栓_Apache Storm_Apache Zookeeper

Apache storm 工人与ZK断开长运行螺栓

apache-storm apache-zookeeper

Apache storm 工人与ZK断开长运行螺栓,apache-storm,apache-zookeeper,Apache Storm,Apache Zookeeper,我有一个螺栓，它使用一个大物体池。当池在4小时内重新初始化时，bolt会等待几秒钟并与zookeper断开连接。我在yaml中指定了以下属性，但仍有工人死亡 supervisor.worker.start.timeout.secs 300 supervisor.worker.timeout.secs 60 以下是日志： 2015-02-17 04:35:01 o.a.z.ClientCnxn [INFO] Client session timed out, have not heard fr

我有一个螺栓，它使用一个大物体池。当池在4小时内重新初始化时，bolt会等待几秒钟并与zookeper断开连接。我在yaml中指定了以下属性，但仍有工人死亡

supervisor.worker.start.timeout.secs 300
supervisor.worker.timeout.secs 60

以下是日志：

2015-02-17 04:35:01 o.a.z.ClientCnxn [INFO] Client session timed out, have not heard from server in 15906ms for sessionid 0x14b9200ea400009, closing socket connection and attempting reconnect
2015-02-17 04:35:01 o.a.c.f.s.ConnectionStateManager [INFO] State change: SUSPENDED
2015-02-17 04:35:01 o.a.c.f.s.ConnectionStateManager [WARN] There are no ConnectionStateListeners registered.
2015-02-17 04:35:01 b.s.cluster [WARN] Received event :disconnected::none: with disconnected Zookeeper.
2015-02-17 04:35:02 o.a.z.ClientCnxn [INFO] Opening socket connection to server realtimeanalytics.novalocal/10.0.0.11:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration)
2015-02-17 04:35:02 o.a.z.ClientCnxn [INFO] Socket connection established to realtimeanalytics.novalocal/10.0.0.11:2181, initiating session
2015-02-17 04:35:02 o.a.z.ClientCnxn [INFO] Session establishment complete on server realtimeanalytics.novalocal/10.0.0.11:2181, sessionid = 0x14b9200ea400009, negotiated timeout = 20000
2015-02-17 04:35:02 o.a.c.f.s.ConnectionStateManager [INFO] State change: RECONNECTED
2015-02-17 04:35:02 o.a.c.f.s.ConnectionStateManager [WARN] There are no ConnectionStateListeners registered.
2015-02-17 04:35:33 o.a.z.ClientCnxn [INFO] Client session timed out, have not heard from server in 13499ms for sessionid 0x14b9200ea400009, closing socket connection and attempting reconnect
2015-02-17 04:35:34 o.a.c.f.s.ConnectionStateManager [INFO] State change: SUSPENDED
2015-02-17 04:35:34 b.s.cluster [WARN] Received event :disconnected::none: with disconnected Zookeeper.
2015-02-17 04:35:34 o.a.c.f.s.ConnectionStateManager [WARN] There are no ConnectionStateListeners registered.

您是否尝试过增加工作人员心跳超时

worker.heartbeat.frequency.secs: 60

zookeeper问题已通过添加storm.zookeeper.session.timeout:40000 storm.zookeeper.connection.timeout:30000得到解决，但工作进程仍被移动到其他节点可能是因为内存压力