Warning: file_get_contents(/data/phpspider/zhask/data//catemap/9/java/327.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
错误backtype.storm.daemon.executor-java.lang.NoClassDefFoundError:org/I0Itec/zkclient/serialize/ZkSerializer_Java_Apache Zookeeper_Apache Storm_Apache Kafka - Fatal编程技术网

错误backtype.storm.daemon.executor-java.lang.NoClassDefFoundError:org/I0Itec/zkclient/serialize/ZkSerializer

错误backtype.storm.daemon.executor-java.lang.NoClassDefFoundError:org/I0Itec/zkclient/serialize/ZkSerializer,java,apache-zookeeper,apache-storm,apache-kafka,Java,Apache Zookeeper,Apache Storm,Apache Kafka,我正在进行kafka storm集成,在执行storm代码时,我遇到了这个错误 ERROR backtype.storm.util - Async loop died! java.lang.NoClassDefFoundError: org/I0Itec/zkclient/serialize/ZkSerializer at kafka.api.OffsetRequest.writeTo(OffsetRequest.scala:65) ~[kafka_2.9.2-0.7.0.jar:na] at

我正在进行kafka storm集成,在执行storm代码时,我遇到了这个错误

ERROR backtype.storm.util - Async loop died!
java.lang.NoClassDefFoundError: org/I0Itec/zkclient/serialize/ZkSerializer
at kafka.api.OffsetRequest.writeTo(OffsetRequest.scala:65) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.network.BoundedByteBufferSend.<init>(BoundedByteBufferSend.scala:43) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.consumer.SimpleConsumer.sendRequest(SimpleConsumer.scala:171) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.consumer.SimpleConsumer.liftedTree3$1(SimpleConsumer.scala:152) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:151) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.javaapi.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:66) ~[kafka_2.9.2-0.7.0.jar:na]
at storm.kafka.PartitionManager.<init>(PartitionManager.java:73) ~[kafka-1.1.jar:na]
at storm.kafka.StaticCoordinator.<init>(StaticCoordinator.java:26) ~[kafka-1.1.jar:na]
at storm.kafka.KafkaSpout.open(KafkaSpout.java:74) ~[kafka-1.1.jar:na]
at backtype.storm.daemon.executor$fn__3489$fn__3504.invoke(executor.clj:499) ~[storm-0.9.0-wip15.jar:na]
at backtype.storm.util$async_loop$fn__436.invoke(util.clj:375) ~[storm-0.9.0-wip15.jar:na]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
Caused by: java.lang.ClassNotFoundException: org.I0Itec.zkclient.serialize.ZkSerializer
at java.net.URLClassLoader$1.run(URLClassLoader.java:366) ~[na:1.7.0_51]
at java.net.URLClassLoader$1.run(URLClassLoader.java:355) ~[na:1.7.0_51]
at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_51]
at java.net.URLClassLoader.findClass(URLClassLoader.java:354) ~[na:1.7.0_51]
at java.lang.ClassLoader.loadClass(ClassLoader.java:425) ~[na:1.7.0_51]
at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ~[na:1.7.0_51]
... 13 common frames omitted
5083 [Thread-26] ERROR backtype.storm.daemon.executor - 
   java.lang.NoClassDefFoundError: org/I0Itec/zkclient/serialize/ZkSerializer
at kafka.api.OffsetRequest.writeTo(OffsetRequest.scala:65) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.network.BoundedByteBufferSend.<init>(BoundedByteBufferSend.scala:43) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.consumer.SimpleConsumer.sendRequest(SimpleConsumer.scala:171) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.consumer.SimpleConsumer.liftedTree3$1(SimpleConsumer.scala:152) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:151) ~[kafka_2.9.2-0.7.0.jar:na]
at kafka.javaapi.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:66) ~[kafka_2.9.2-0.7.0.jar:na]
at storm.kafka.PartitionManager.<init>(PartitionManager.java:73) ~[kafka-1.1.jar:na]
at storm.kafka.StaticCoordinator.<init>(StaticCoordinator.java:26) ~[kafka-1.1.jar:na]
at storm.kafka.KafkaSpout.open(KafkaSpout.java:74) ~[kafka-1.1.jar:na]
at backtype.storm.daemon.executor$fn__3489$fn__3504.invoke(executor.clj:499) ~[storm-0.9.0-wip15.jar:na]
at backtype.storm.util$async_loop$fn__436.invoke(util.clj:375) ~[storm-0.9.0-wip15.jar:na]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
Caused by: java.lang.ClassNotFoundException: org.I0Itec.zkclient.serialize.ZkSerializer
at java.net.URLClassLoader$1.run(URLClassLoader.java:366) ~[na:1.7.0_51]
at java.net.URLClassLoader$1.run(URLClassLoader.java:355) ~[na:1.7.0_51]
at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_51]
at java.net.URLClassLoader.findClass(URLClassLoader.java:354) ~[na:1.7.0_51]
at java.lang.ClassLoader.loadClass(ClassLoader.java:425) ~[na:1.7.0_51]
at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ~[na:1.7.0_51]
... 13 common frames omitted
5090 [Thread-13-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update:     :connected:none
5090 [Thread-10-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update:     :connected:none
5101 [Thread-13] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting
5112 [Thread-10] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl -     Starting
5204 [Thread-26] INFO  backtype.storm.util - Halting process: ("Worker died")
错误backtype.storm.util-异步循环已终止!
java.lang.NoClassDefFoundError:org/I0Itec/zkclient/serialize/ZkSerializer
在kafka.api.OffsetRequest.writeTo(OffsetRequest.scala:65)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.network.BoundedByteBufferSend.(BoundedByteBufferSend.scala:43)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.consumer.SimpleConsumer.sendRequest(SimpleConsumer.scala:171)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.consumer.SimpleConsumer.liftedTree3$1(SimpleConsumer.scala:152)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:151)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.javaapi.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:66)~[kafka_2.9.2-0.7.0.jar:na]
在storm.kafka.PartitionManager.(PartitionManager.java:73)~[kafka-1.1.jar:na]
atstorm.kafka.StaticCoordinator.(StaticCoordinator.java:26)~[kafka-1.1.jar:na]
在storm.kafka.KafkaSpout.open(KafkaSpout.java:74)~[kafka-1.1.jar:na]
在backtype.storm.daemon.executor$fn_u3489$fn_u3504.invoke(executor.clj:499)~[storm-0.9.0-wip15.jar:na]
在backtype.storm.util$async\u循环$fn\uu 436.invoke(util.clj:375)~[storm-0.9.0-wip15.jar:na]
在clojure.lang.AFn.run(AFn.java:24)[clojure-1.4.0.jar:na]
在java.lang.Thread.run(Thread.java:744)[na:1.7.0_51]
原因:java.lang.ClassNotFoundException:org.I0Itec.zkclient.serialize.ZkSerializer
在java.net.URLClassLoader$1.run(URLClassLoader.java:366)~[na:1.7.0\u 51]
在java.net.URLClassLoader$1.run(URLClassLoader.java:355)~[na:1.7.0\u 51]
在java.security.AccessController.doPrivileged(本机方法)~[na:1.7.0_51]
在java.net.URLClassLoader.findClass(URLClassLoader.java:354)~[na:1.7.051]
在java.lang.ClassLoader.loadClass(ClassLoader.java:425)~[na:1.7.0_51]
在java.lang.ClassLoader.loadClass(ClassLoader.java:358)~[na:1.7.0_51]
... 省略13个公共框架
5083[Thread-26]错误backtype.storm.daemon.executor-
java.lang.NoClassDefFoundError:org/I0Itec/zkclient/serialize/ZkSerializer
在kafka.api.OffsetRequest.writeTo(OffsetRequest.scala:65)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.network.BoundedByteBufferSend.(BoundedByteBufferSend.scala:43)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.consumer.SimpleConsumer.sendRequest(SimpleConsumer.scala:171)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.consumer.SimpleConsumer.liftedTree3$1(SimpleConsumer.scala:152)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:151)~[kafka_2.9.2-0.7.0.jar:na]
在kafka.javaapi.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:66)~[kafka_2.9.2-0.7.0.jar:na]
在storm.kafka.PartitionManager.(PartitionManager.java:73)~[kafka-1.1.jar:na]
atstorm.kafka.StaticCoordinator.(StaticCoordinator.java:26)~[kafka-1.1.jar:na]
在storm.kafka.KafkaSpout.open(KafkaSpout.java:74)~[kafka-1.1.jar:na]
在backtype.storm.daemon.executor$fn_u3489$fn_u3504.invoke(executor.clj:499)~[storm-0.9.0-wip15.jar:na]
在backtype.storm.util$async\u循环$fn\uu 436.invoke(util.clj:375)~[storm-0.9.0-wip15.jar:na]
在clojure.lang.AFn.run(AFn.java:24)[clojure-1.4.0.jar:na]
在java.lang.Thread.run(Thread.java:744)[na:1.7.0_51]
原因:java.lang.ClassNotFoundException:org.I0Itec.zkclient.serialize.ZkSerializer
在java.net.URLClassLoader$1.run(URLClassLoader.java:366)~[na:1.7.0\u 51]
在java.net.URLClassLoader$1.run(URLClassLoader.java:355)~[na:1.7.0\u 51]
在java.security.AccessController.doPrivileged(本机方法)~[na:1.7.0_51]
在java.net.URLClassLoader.findClass(URLClassLoader.java:354)~[na:1.7.051]
在java.lang.ClassLoader.loadClass(ClassLoader.java:425)~[na:1.7.0_51]
在java.lang.ClassLoader.loadClass(ClassLoader.java:358)~[na:1.7.0_51]
... 省略13个公共框架
5090[Thread-13-EventThread]信息backtype.storm.zookeeper-zookeeper状态更新::已连接:无
5090[Thread-10-EventThread]INFO backtype.storm.zookeeper-zookeeper状态更新::已连接:无
5101[Thread-13]INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl-开始
5112[Thread-10]INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl-正在启动
5204[Thread-26]INFO backtype.storm.util-停止进程:(“工人死亡”)
我的pom文件中没有zkclient


有什么问题?请帮助

您应该在storm lib文件夹中有zkclient.jar。应该有用。否则,您应该安装更高版本的jar。卡夫卡使用zkclient与Zookeeper通信。顺便说一句,你应该选择Kafka 0.8.0,因为它有复制功能。

你是如何安装Kafka的,Storm Kafka?哪个风暴版本和哪个卡夫卡版本?风暴-0.9.0-wip16和卡夫卡-0.7.2-incubating-src我相信版本不会有问题。我以前执行过这个程序,没有足够的解释,没有人能帮助你。。我不知道突然出了什么问题。。这是动物园管理员的问题吗。我在kafka中使用默认的zookeeper。我在storm lib文件夹中添加了jar文件。。也尝试了不同的版本。。仍然是相同的errorNipun,storm contrib中提供的卡夫卡喷口的最新版本仅支持卡夫卡0.7.0。请参阅此处的文档:@Svend Correct。但是我们自己也可以很容易地写一个。实际上,在我当前的项目中,我们使用的是卡夫卡0.8.0和风暴0.9.0.1。我们正在使用高级卡夫卡消费者,它负责寻找领导者、消费者重新平衡、维护zookeeper上的主题/分区/偏移量等。听起来很酷!Nipun,如果您的公司决定开源,请让我知道,0.8中确实有一些很酷的功能,我们想让您亲身体验:)@Svend不幸的是,我们无法开源。