Fatal编程技术网
  • apache-storm/
  • Apache storm 阿帕奇风暴中的新卡夫卡问题

Apache storm 阿帕奇风暴中的新卡夫卡问题

apache-storm

Apache storm 阿帕奇风暴中的新卡夫卡问题,apache-storm,apache-storm-topology,Apache Storm,Apache Storm Topology,我有一个基本的拓扑结构，包括卡夫卡喷口和卡夫卡螺栓 当提交我的拓扑时，ı在Storm UI中出现此错误 无法获取卡夫卡的偏移滞后。原因：org.apache.kafka.shade.common.errors.InvalidTopiceException:主题“[enrich Topic]”无效 我检查丰富主题是否存在，没有问题 TopologyBuilder streamTopologyBuilder = new TopologyBuilder(); KafkaSpoutRe

我有一个基本的拓扑结构，包括卡夫卡喷口和卡夫卡螺栓 当提交我的拓扑时，ı在Storm UI中出现此错误

无法获取卡夫卡的偏移滞后。原因：org.apache.kafka.shade.common.errors.InvalidTopiceException:主题“[enrich Topic]”无效

我检查丰富主题是否存在，没有问题

    TopologyBuilder streamTopologyBuilder = new TopologyBuilder();

    KafkaSpoutRetryService kafkaSpoutRetryService =  new KafkaSpoutRetryExponentialBackoff(KafkaSpoutRetryExponentialBackoff.TimeInterval.microSeconds(500), KafkaSpoutRetryExponentialBackoff.TimeInterval.milliSeconds(2), Integer.MAX_VALUE, KafkaSpoutRetryExponentialBackoff.TimeInterval.seconds(10));

    KafkaSpoutConfig spoutConf =  KafkaSpoutConfig.builder(configProvider.getBootstrapServers(), configProvider.getSpoutTopic())
            .setGroupId("consumerGroupId")
            .setOffsetCommitPeriodMs(10_000)
            .setFirstPollOffsetStrategy(UNCOMMITTED_LATEST)
            .setMaxUncommittedOffsets(1000000)
            .setRetry(kafkaSpoutRetryService)
            .build();
    KafkaSpout kafkaSpout = new KafkaSpout(spoutConf);
    streamTopologyBuilder.setSpout("kafkaSpout", kafkaSpout, 1);

    KafkaWriterBolt2 kafkaWriterBolt2 = null;
    try {
        kafkaWriterBolt2 = new KafkaWriterBolt2(configProvider.getBootstrapServers(), configProvider.getStreamKafkaWriterTopicName());
    } catch (IOException e) {
        e.printStackTrace();
    }
    streamTopologyBuilder.setBolt("kafkaWriterBolt2", kafkaWriterBolt2, 1).setNumTasks(1)
            .shuffleGrouping("kafkaSpout");
KafkaWriterBolt2是我的类从BaseRichBolt扩展而来的