Docker 卡夫卡消费者无法连接
我在docker经营卡夫卡和动物园管理员Docker 卡夫卡消费者无法连接,docker,apache-kafka,kafka-consumer-api,Docker,Apache Kafka,Kafka Consumer Api,我在docker经营卡夫卡和动物园管理员 CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 34a113626eb6 confluent/kafka "
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
34a113626eb6 confluent/kafka "/usr/local/bin/ka..." 11 minutes ago Up 11 minutes 0.0.0.0:9092->9092/tcp kafka
552d1d787b9e confluent/zookeeper "/usr/local/bin/zk..." 12 minutes ago Up 12 minutes 0.0.0.0:2181->2181/tcp, 0.0.0.0:2888->2888/tcp, 0.0.0.0:3888->3888/tcp zookeeper
但当我使用kafka命令行发送消费者消息时,我看到了以下错误:
iMac:kafka lluo$ bin/kafka-console-consumer.sh --zookeeper `docker-machine ip bigdata`:2181 --topic bigdata
Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper].
[2018-10-09 09:09:05,504] WARN [ConsumerFetcherThread-console-consumer-62804_Russells-iMac.hsd1.ca.comcast.net-1539101285161-d8affa4e-0-0]: Error in fetch to broker 0, request Name: FetchRequest; Version: 3; CorrelationId: 0; ClientId: console-consumer-62804; ReplicaId: -1; MaxWait: 100 ms; MinBytes: 1 bytes; MaxBytes:2147483647 bytes; RequestInfo: ([bigdata,0],PartitionFetchInfo(5,1048576)) (kafka.consumer.ConsumerFetcherThread)
java.net.SocketTimeoutException
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:211)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
at java.nio.channels.Channels$ReadableByteChannelImpl.read(Channels.java:385)
at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:85)
at kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:131)
at kafka.network.BlockingChannel.receive(BlockingChannel.scala:122)
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:102)
at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:86)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:135)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:135)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:135)
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:31)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:134)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:134)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:134)
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:31)
at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:133)
at kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:114)
at kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:35)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:151)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:112)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
以前有人解决过这个问题吗 您需要使用
引导服务器,而不是zookeeper
(端口9092是默认值)。
您得到的警告清楚地表明您一直在使用旧的消费者,该消费者已被弃用
Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper].
由于卡夫卡已将偏移存储从Zookeeper移动到代理,卡夫卡消费者需要引导服务器
参数,因为它需要连接到卡夫卡代理,因此无需直接与Zookeeper通信 代替zookeeper,尝试通过引导服务器(默认情况下为9092端口)。您可以检查端口是否已打开且未被防火墙阻止。感谢Giorgos,当我使用引导服务器时,它工作正常。你知道动物园管理员的方法不起作用的原因吗?@Russell.Luo看看我的答案。希望有帮助。不过需要设置广告听众。谢谢Giorgos和cricket_007。