Apache storm supervisor[错误]初始化服务器mk supervisor时出错

Apache storm supervisor[错误]初始化服务器mk supervisor时出错,apache-storm,topology,Apache Storm,Topology,我在一台生产服务器上设置了storm,它工作得很好,直到我突然断电。现在,每当我尝试推送拓扑时,我在初始化服务器mk supervisor时都会收到supervisor error supervisor[error]error。Storm ui nolonger显示我的工人数量(过去是4);现在是0。 我知道主管不再工作正常,但重新安装主管并不能解决问题。我以前的设置有这个问题,导致我重新进行整个设置以使其正常工作。但我不能在主管失败时继续进行设置 2014-04-06 23:59:48 sup

我在一台生产服务器上设置了storm,它工作得很好,直到我突然断电。现在,每当我尝试推送拓扑时,我在初始化服务器mk supervisor时都会收到supervisor error supervisor[error]error。Storm ui nolonger显示我的工人数量(过去是4);现在是0。 我知道主管不再工作正常,但重新安装主管并不能解决问题。我以前的设置有这个问题,导致我重新进行整个设置以使其正常工作。但我不能在主管失败时继续进行设置

2014-04-06 23:59:48 supervisor [INFO] Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 5000, "topology.skip.missing.kryo.registrations" false, "ui.childopts" "-Xmx768m -Djava.net.preferIPv4Stack=true", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 500, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "/var/storm", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "192.168.254.145", "storm.zookeeper.port" 2181, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["192.168.254.145"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m -Djava.net.preferIPv4Stack=true", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Djava.net.preferIPv4Stack=true", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m -Djava.net.preferIPv4Stack=true", "storm.cluster.mode" "distributed", "topology.optimize" true, "topology.max.task.parallelism" nil}

  2014-04-06 23:59:48 supervisor [ERROR] Error on initialization of server mk-supervisor
java.lang.RuntimeException: java.io.EOFException
    at backtype.storm.utils.Utils.deserialize(Utils.java:68)
    at backtype.storm.utils.LocalState.snapshot(LocalState.java:24)
    at backtype.storm.utils.LocalState.get(LocalState.java:28)
    at backtype.storm.daemon.supervisor$standalone_supervisor$reify__4810.prepare(supervisor.clj:486)
    at backtype.storm.daemon.supervisor$fn__4757$exec_fn__1228__auto____4758.invoke(supervisor.clj:329)
    at clojure.lang.AFn.applyToHelper(AFn.java:167)
    at clojure.lang.AFn.applyTo(AFn.java:151)
    at clojure.core$apply.invoke(core.clj:601)
    at backtype.storm.daemon.supervisor$fn__4757$mk_supervisor__4782.doInvoke(supervisor.clj:327)
    at clojure.lang.RestFn.invoke(RestFn.java:436)
    at backtype.storm.daemon.supervisor$_launch.invoke(supervisor.clj:477)
    at backtype.storm.daemon.supervisor$_main.invoke(supervisor.clj:506)
    at clojure.lang.AFn.applyToHelper(AFn.java:159)
    at clojure.lang.AFn.applyTo(AFn.java:151)
    at backtype.storm.daemon.supervisor.main(Unknown Source)
Caused by: java.io.EOFException
    at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323)
    at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2792)
    at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:800)
    at java.io.ObjectInputStream.<init>(ObjectInputStream.java:298)
    at backtype.storm.utils.Utils.deserialize(Utils.java:63)
2014-04-06 23:59:48 supervisor[INFO]使用conf{“dev.zookeeper.path”“/tmp/dev storm zookeeper”“topology.tick.tuple.freq.secs”nil,“topology.fall.back.on.java.serialization”true,“topology.max.error.report.per.interval”5,“zmq.linger.milis”5000,“topology.skip.missing.kryo.registrations”false,“ui.childopts”“-Xmx768m-Djava.net.preferIPv4Stack=true”,“storm.zookeeper.session.timeout”20000,“nimbus.reassign”true,“topology.trident.batch.emit.interval.millis”500,“nimbus.monitor.freq.secs”10,“java.library.path”“/usr/local/lib:/opt/local/lib:/usr/lib”,“topologology.executor.send.buffer.size”1024,“storm.local.dir”“/var/storm””supervisor.worker.start.timeout.secs“120”,topology.enable.message.timeout“true”,nimbus.cleanup.inbox.freq.secs“600”,nimbus.inbox.jar.expiration.secs“3600”,drpc.worker.threads“64”,topology.worker.shared.thread.pool.size“4”,nimbus.host“192.168.254.145”,“storm.zookeeper.port”2181,“transactional.zookeeper.port”niltopology.executor.receive.buffer.size“1024”,transactional.zookeeper.servers“nil”,storm.zookeeper.root“/storm”,“supervisor.enable”true,“storm.zookeeper.servers”[“192.168.254.145”],“transactional.zookeeper.root”“/transactional”,“topology.acker.executors”1,“topology.transfer.buffer.size”1024,“topology.worker.childopts”drpc.queue.size“128”,worker.childopts”“-Xmx768m-Djava.net.preferIPv4Stack=true,“supervisor.heartbeat.frequency.secs”5,“topology.error.throttle.interval.secs”10,“zmq.hwm”0,“drpc.port”3772,“supervisor.monitor.frequency.secs”3,“topology.receiver.bufference.size”8,“task.heartbeat.frequency.secs”3,“topology.tasks”niltopology.Spoot.wait.strategy“”backtype.storm.Spoot.SleepSpootWaitStrategy“,”topology.max.Spoot.pending“nil”,storm.zookeeper.retry.interval“1000”,topology.sleep.Spoot.wait.strategy.time.ms“1”,nimbus.topology.validator“,”backtype.storm.nimbus.DefaultTopologyValidator“,”supervisor.slots.ports“[6700 6701 6702 6703],”Topnimbus.task.launch.secs“120”,nimbus.supervisor.timeout.secs“60”,topology.message.timeout.secs“30”,task.refresh.poll.secs“10”,topology.workers“1”,supervisor.childopts”“-Djava.net.preferIPv4Stack=true,“nimbus.thrift.port”6627,topology.stats.sample.rate“0.05”,worker.heartbeat.frequency.secs“1”,topology.acker.tasks“nil”topology.disruptor.wait.strategy“、com.lmax.disruptor.BlockingWaitStrategy”、“nimbus.task.timeout.secs”30、“storm.zookeeper.connection.timeout”15000、“topology.kryo.factory”、“backtype.storm.serialization.DefaultKryoFactory”、“drpc.invocations.port”3773、“zmq.threads”1、“storm.zookeeper.retry.times”5、“拓扑.state.synchronization.timeout.secs“60”,supervisor.worker.timeout.secs“30”,nimbus.file.copy.expiration.secs“600”,drpc.request.timeout.secs“600”,storm.local.mode.zmq“false”,ui.port“8080”,nimbus.childopts“-Xmx1024m-Djava.net.preferIPv4Stack=true”,“storm.cluster.mode”“distributed”,“拓扑优化”truetopology.max.task.parallelism“nil}
2014-04-06 23:59:48监控程序[错误]服务器mk监控程序初始化时出错
java.lang.RuntimeException:java.io.EOFEException
反序列化(utils.java:68)
位于backtype.storm.utils.LocalState.snapshot(LocalState.java:24)
位于backtype.storm.utils.LocalState.get(LocalState.java:28)
在backtype.storm.daemon.supervisor$standalone\u supervisor$reify\u\u 4810.prepare(supervisor.clj:486)
在backtype.storm.daemon.supervisor$fn\uuuu 4757$exec\u fn\uuuuu 1228\uuuu auto\uuuuuuuuu 4758.invoke(supervisor.clj:329)
位于clojure.lang.AFn.applyToHelper(AFn.java:167)
在clojure.lang.AFn.applyTo(AFn.java:151)
在clojure.core$apply.invoke(core.clj:601)
在backtype.storm.daemon.supervisor$fn__4757$mk_supervisor__4782.doInvoke(supervisor.clj:327)
位于clojure.lang.RestFn.invoke(RestFn.java:436)
在backtype.storm.daemon.supervisor$\u launch.invoke(supervisor.clj:477)中
在backtype.storm.daemon.supervisor$\u main.invoke处(supervisor.clj:506)
位于clojure.lang.AFn.applyToHelper(AFn.java:159)
在clojure.lang.AFn.applyTo(AFn.java:151)
位于backtype.storm.daemon.supervisor.main(未知源)
原因:java.io.EOFException
在java.io.ObjectInputStream$PeekInputStream.readFully处(ObjectInputStream.java:2323)
位于java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2792)
位于java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:800)
位于java.io.ObjectInputStream。(ObjectInputStream.java:298)
反序列化(utils.java:63)

我不知道停电期间到底发生了什么。我在这里迷路了……请帮助我

我想你需要做的是清除Storm使用的所有本地目录(至少,如果需要,将它们移动到其他地方进行某种备份)

本地目录是您在
conf/storm.yaml
中配置的目录


这是由于Storm没有正确关闭。

什么是本地目录?配置为Storm.local.dir:“/var/Storm”。清除目录确实解决了问题。您可以帮助解决此问题吗?请帮助解决此问题