Macos Mac上的Kafka启动console consumer时,没有对node-1的飞行中请求

Macos Mac上的Kafka启动console consumer时,没有对node-1的飞行中请求,macos,apache-kafka,Macos,Apache Kafka,我是Kafka新手,尝试安装并运行console consumer,但出现错误java.lang.IllegalStateException:没有针对节点-1的飞行中请求 我试过的环境如下 Kafka Version kafka_2.13-2.6.0 MacOS java11 Fails MacOS java 1.8 Fails Windows 10 Java11 Success 下面是我正在执行的详细步骤。同样的步骤也适用于Windows 步骤1下载卡夫卡 我刚从网上下载了卡夫卡 第2步启动

我是Kafka新手,尝试安装并运行console consumer,但出现错误
java.lang.IllegalStateException:没有针对节点-1的飞行中请求

我试过的环境如下

Kafka Version kafka_2.13-2.6.0
MacOS java11 Fails
MacOS java 1.8 Fails
Windows 10 Java11 Success
下面是我正在执行的详细步骤。同样的步骤也适用于Windows

步骤1下载卡夫卡

我刚从网上下载了卡夫卡

第2步启动zookeeper服务,该服务工作正常

我用下面的命令启动zookeeper

bin % zookeeper-server-start.sh ../config/zookeeper.properties
bin % kafka-server-start.sh ../config/server.properties
这是动物园管理员日志

[2020-08-30 14:28:52,234] INFO Server environment:java.io.tmpdir=/var/folders/q7/khp8p9k14rzfs_zl52m57hlr0000gn/T/ (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:java.compiler=<NA> (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:os.name=Mac OS X (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:os.arch=x86_64 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:os.version=10.15.6 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:user.name=jigarnaik (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:user.home=/Users/jigarnaik (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:user.dir=/Users/jigarnaik/Documents/kafka_2.13-2.6.0/bin (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:os.memory.free=496MB (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:os.memory.max=512MB (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,234] INFO Server environment:os.memory.total=512MB (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,235] INFO minSessionTimeout set to 6000 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,235] INFO maxSessionTimeout set to 60000 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,236] INFO Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 60000 datadir /tmp/zookeeper/version-2 snapdir /tmp/zookeeper/version-2 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-08-30 14:28:52,243] INFO Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory (org.apache.zookeeper.server.ServerCnxnFactory)
[2020-08-30 14:28:52,247] INFO Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 32 worker threads, and 64 kB direct buffers. (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2020-08-30 14:28:52,254] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2020-08-30 14:28:52,268] INFO zookeeper.snapshotSizeFactor = 0.33 (org.apache.zookeeper.server.ZKDatabase)
[2020-08-30 14:28:52,271] INFO Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0 (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2020-08-30 14:28:52,273] INFO Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0 (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2020-08-30 14:28:52,286] INFO Using checkIntervalMs=60000 maxPerMinute=10000 (org.apache.zookeeper.server.ContainerManager)
load: 1.58  cmd: java 17764 waiting 0.68u 0.11s
卡夫卡初创公司看起来不错,有下面的日志尾

[2020-08-30 14:33:41,708] INFO [TransactionCoordinator id=0] Starting up. (kafka.coordinator.transaction.TransactionCoordinator)
[2020-08-30 14:33:41,709] INFO [Transaction Marker Channel Manager 0]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager)
[2020-08-30 14:33:41,709] INFO [TransactionCoordinator id=0] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator)
[2020-08-30 14:33:41,728] INFO [ExpirationReaper-0-AlterAcls]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2020-08-30 14:33:41,757] INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread)
[2020-08-30 14:33:41,770] INFO [SocketServer brokerId=0] Starting socket server acceptors and processors (kafka.network.SocketServer)
[2020-08-30 14:33:41,773] INFO [SocketServer brokerId=0] Started data-plane acceptor and processor(s) for endpoint : ListenerName(PLAINTEXT) (kafka.network.SocketServer)
[2020-08-30 14:33:41,773] INFO [SocketServer brokerId=0] Started socket server acceptors and processors (kafka.network.SocketServer)
[2020-08-30 14:33:41,775] INFO Kafka version: 2.6.0 (org.apache.kafka.common.utils.AppInfoParser)
[2020-08-30 14:33:41,775] INFO Kafka commitId: 62abe01bee039651 (org.apache.kafka.common.utils.AppInfoParser)
[2020-08-30 14:33:41,775] INFO Kafka startTimeMs: 1598769221773 (org.apache.kafka.common.utils.AppInfoParser)
[2020-08-30 14:33:41,776] INFO [KafkaServer id=0] started (kafka.server.KafkaServer)
[2020-08-30 14:33:41,808] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions Set(word-count-output-0, word-count-input-0) (kafka.server.ReplicaFetcherManager)
[2020-08-30 14:33:41,815] INFO [Partition word-count-output-0 broker=0] Log loaded for partition word-count-output-0 with initial high watermark 0 (kafka.cluster.Partition)
[2020-08-30 14:33:41,821] INFO [Partition word-count-input-0 broker=0] Log loaded for partition word-count-input-0 with initial high watermark 0 (kafka.cluster.Partition)
步骤4创建主题,主题创建成功。 之后,我将创建主题

列表主题

bin % kafka-topics.sh \
    --list \
    --zookeeper localhost:2181
my-topic
word-count-input
word-count-output
步骤5运行console producer失败,出现以下错误

但是当我尝试使用下面的命令启动console producer时,我得到了异常
java.lang.IllegalStateException:没有对node-1的飞行中请求
当我在windows上运行时,它工作正常,我只在Mac上遇到问题

bin % kafka-console-producer.sh \
    --topic word-count-input \
    --bootstrap-server localhost:9092
>[2020-08-30 14:35:17,902] ERROR [Producer clientId=console-producer] Uncaught error in kafka producer I/O thread:  (org.apache.kafka.clients.producer.internals.Sender)
java.nio.BufferUnderflowException
    at java.nio.Buffer.nextGetIndex(Buffer.java:509)
    at java.nio.HeapByteBuffer.getInt(HeapByteBuffer.java:364)
    at org.apache.kafka.common.protocol.ByteBufferAccessor.readInt(ByteBufferAccessor.java:43)
    at org.apache.kafka.common.message.ResponseHeaderData.read(ResponseHeaderData.java:102)
    at org.apache.kafka.common.message.ResponseHeaderData.<init>(ResponseHeaderData.java:70)
    at org.apache.kafka.common.requests.ResponseHeader.parse(ResponseHeader.java:66)
    at org.apache.kafka.clients.NetworkClient.parseStructMaybeUpdateThrottleTimeMetrics(NetworkClient.java:717)
    at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:834)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:553)
    at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
    at java.lang.Thread.run(Thread.java:748)
[2020-08-30 14:35:17,904] ERROR [Producer clientId=console-producer] Uncaught error in kafka producer I/O thread:  (org.apache.kafka.clients.producer.internals.Sender)
java.lang.IllegalStateException: There are no in-flight requests for node -1
    at org.apache.kafka.clients.InFlightRequests.requestQueue(InFlightRequests.java:62)
    at org.apache.kafka.clients.InFlightRequests.completeNext(InFlightRequests.java:70)
    at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:833)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:553)
    at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
    at java.lang.Thread.run(Thread.java:748)
[2020-08-30 14:35:17,938] ERROR Uncaught exception in thread 'kafka-producer-network-thread | console-producer': (org.apache.kafka.common.utils.KafkaThread)
java.lang.OutOfMemoryError: Java heap space
    at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
    at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
    at org.apache.kafka.common.memory.MemoryPool$1.tryAllocate(MemoryPool.java:30)
    at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:113)
    at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:447)
    at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:397)
    at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:678)
    at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:580)
    at org.apache.kafka.common.network.Selector.poll(Selector.java:485)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:544)
    at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
    at java.lang.Thread.run(Thread.java:748)
bin%kafka-console-producer.sh\
--主题字数输入\
--引导服务器本地主机:9092
>[2020-08-30 14:35:17902]错误[Producer clientId=console Producer]卡夫卡生产者I/O线程中的未捕获错误:(org.apache.kafka.clients.Producer.internals.Sender)
java.nio.BufferUnderflowException
位于java.nio.Buffer.nextGetIndex(Buffer.java:509)
位于java.nio.HeapByteBuffer.getInt(HeapByteBuffer.java:364)
位于org.apache.kafka.common.protocol.ByteBufferAccessor.readInt(ByteBufferAccessor.java:43)
位于org.apache.kafka.common.message.ResponseHeaderData.read(ResponseHeaderData.java:102)
位于org.apache.kafka.common.message.ResponseHeaderData(ResponseHeaderData.java:70)
位于org.apache.kafka.common.requests.ResponseHeader.parse(ResponseHeader.java:66)
位于org.apache.kafka.clients.NetworkClient.parseStructMaybeUpdateThrottletTimeMetrics(NetworkClient.java:717)
位于org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:834)
位于org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:553)
位于org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
位于org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
运行(Thread.java:748)
[2020-08-30 14:35:17904]错误[Producer clientId=console Producer]卡夫卡生产者I/O线程中的未捕获错误:(org.apache.kafka.clients.Producer.internals.Sender)
java.lang.IllegalStateException:节点-1没有正在运行的请求
位于org.apache.kafka.clients.InFlightRequests.requestQueue(InFlightRequests.java:62)
位于org.apache.kafka.clients.InFlightRequests.completeNext(InFlightRequests.java:70)
位于org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:833)
位于org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:553)
位于org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
位于org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
运行(Thread.java:748)
[2020-08-30 14:35:17938]线程“kafka producer network thread | console producer”中出现错误未捕获异常:(org.apache.kafka.common.utils.KafkaThread)
java.lang.OutOfMemoryError:java堆空间
位于java.nio.HeapByteBuffer。(HeapByteBuffer.java:57)
位于java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
位于org.apache.kafka.common.memory.MemoryPool$1.tryAllocate(MemoryPool.java:30)
位于org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:113)
位于org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:447)
位于org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:397)
位于org.apache.kafka.common.network.Selector.attemptRead(Selector.java:678)
位于org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:580)
位于org.apache.kafka.common.network.Selector.poll(Selector.java:485)
位于org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:544)
位于org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
位于org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
运行(Thread.java:748)

最后我发现了问题,sonarqube正在我的本地计算机上运行该端口,但令人惊讶的是,当我启动kafka时,没有报告错误。

我的norton antivirus防火墙设置导致了此问题。我禁用了防火墙设置,一切正常。

它适用于卡夫卡2.0.0版
bin % kafka-console-producer.sh \
    --topic word-count-input \
    --bootstrap-server localhost:9092
>[2020-08-30 14:35:17,902] ERROR [Producer clientId=console-producer] Uncaught error in kafka producer I/O thread:  (org.apache.kafka.clients.producer.internals.Sender)
java.nio.BufferUnderflowException
    at java.nio.Buffer.nextGetIndex(Buffer.java:509)
    at java.nio.HeapByteBuffer.getInt(HeapByteBuffer.java:364)
    at org.apache.kafka.common.protocol.ByteBufferAccessor.readInt(ByteBufferAccessor.java:43)
    at org.apache.kafka.common.message.ResponseHeaderData.read(ResponseHeaderData.java:102)
    at org.apache.kafka.common.message.ResponseHeaderData.<init>(ResponseHeaderData.java:70)
    at org.apache.kafka.common.requests.ResponseHeader.parse(ResponseHeader.java:66)
    at org.apache.kafka.clients.NetworkClient.parseStructMaybeUpdateThrottleTimeMetrics(NetworkClient.java:717)
    at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:834)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:553)
    at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
    at java.lang.Thread.run(Thread.java:748)
[2020-08-30 14:35:17,904] ERROR [Producer clientId=console-producer] Uncaught error in kafka producer I/O thread:  (org.apache.kafka.clients.producer.internals.Sender)
java.lang.IllegalStateException: There are no in-flight requests for node -1
    at org.apache.kafka.clients.InFlightRequests.requestQueue(InFlightRequests.java:62)
    at org.apache.kafka.clients.InFlightRequests.completeNext(InFlightRequests.java:70)
    at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:833)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:553)
    at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
    at java.lang.Thread.run(Thread.java:748)
[2020-08-30 14:35:17,938] ERROR Uncaught exception in thread 'kafka-producer-network-thread | console-producer': (org.apache.kafka.common.utils.KafkaThread)
java.lang.OutOfMemoryError: Java heap space
    at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
    at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
    at org.apache.kafka.common.memory.MemoryPool$1.tryAllocate(MemoryPool.java:30)
    at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:113)
    at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:447)
    at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:397)
    at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:678)
    at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:580)
    at org.apache.kafka.common.network.Selector.poll(Selector.java:485)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:544)
    at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
    at java.lang.Thread.run(Thread.java:748)