在kafka群集上启用ssl时,kafka connect无法启动

在kafka群集上启用ssl时,kafka connect无法启动,ssl,apache-kafka,apache-kafka-connect,confluent-platform,Ssl,Apache Kafka,Apache Kafka Connect,Confluent Platform,我试图评估卡夫卡融合平台4.0版。但是,当我在kafka群集上启用ssl时,kafka连接无法启动 详细记录如下: [2017-12-18 04:38:55,747] ERROR Uncaught exception in herder work thread, exiting: (org.apache.kafka.connect.runtime.distributed.DistributedHerder:218) org.apache.kafka.connect.errors.Connect

我试图评估卡夫卡融合平台4.0版。但是,当我在kafka群集上启用ssl时,kafka连接无法启动

详细记录如下:

[2017-12-18 04:38:55,747] ERROR Uncaught exception in herder work thread, exiting:  (org.apache.kafka.connect.runtime.distributed.DistributedHerder:218)
org.apache.kafka.connect.errors.ConnectException: Timed out while checking for or creating topic(s) 'connect-offsets'. This could indicate a connectivity issue, unavailable topic partitions, or if this is your first use of the topic it may have taken too long to create.
        at org.apache.kafka.connect.util.TopicAdmin.createTopics(TopicAdmin.java:243)
        at org.apache.kafka.connect.storage.KafkaOffsetBackingStore$1.run(KafkaOffsetBackingStore.java:99)
        at org.apache.kafka.connect.util.KafkaBasedLog.start(KafkaBasedLog.java:126)
        at org.apache.kafka.connect.storage.KafkaOffsetBackingStore.start(KafkaOffsetBackingStore.java:109)
        at org.apache.kafka.connect.runtime.Worker.start(Worker.java:144)
        at org.apache.kafka.connect.runtime.AbstractHerder.startServices(AbstractHerder.java:100)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:205)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment.
[2017-12-18 04:38:55,752] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:65)
[2017-12-18 04:38:55,753] INFO Stopping REST server (org.apache.kafka.connect.runtime.rest.RestServer:154)
[2017-12-18 04:38:55,761] INFO Stopped ServerConnector@51012d9c{HTTP/1.1}{0.0.0.0:8083} (org.eclipse.jetty.server.ServerConnector:306)
[2017-12-18 04:38:55,783] INFO Stopped o.e.j.s.ServletContextHandler@77a001d8{/,null,UNAVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:865)
[2017-12-18 04:38:55,786] INFO REST server stopped (org.apache.kafka.connect.runtime.rest.RestServer:165)
[2017-12-18 04:38:55,787] INFO Herder stopping (org.apache.kafka.connect.runtime.distributed.DistributedHerder:389)
[2017-12-18 04:39:00,788] INFO Herder stopped (org.apache.kafka.connect.runtime.distributed.DistributedHerder:409)
[2017-12-18 04:39:00,789] INFO Kafka Connect stopped (org.apache.kafka.connect.runtime.Connect:70)
我已经检查过卡夫卡经纪人,他们仍在正常运行

bin/confluent status
connect is [DOWN]
kafka-rest is [UP]
schema-registry is [DOWN]
kafka is [UP]
zookeeper is [UP]
我错过了什么额外的配置


请告知?

在Kafka群集上启用安全选项后,您需要为Kafka Connect Worker启用等效选项

例如,对于基本SSL配置,您可能需要设置如下内容:

security.protocol=SSL
ssl.truststore.location=/var/private/ssl/kafka.client.truststore.jks
ssl.truststore.password=<your-pass>
security.protocol=SSL
ssl.truststore.location=/var/private/ssl/kafka.client.truststore.jks
ssl.truststore.password=
到您工作人员的配置。(如上图所示,要尝试使用Confluent CLI,此文件为
/etc/schema registry/connect avro distributed.properties

您可以在此处阅读有关如何设置Kafka Connect with security的更多信息:

并在此处查找有关Connect workers的所有可用安全相关属性:


当我将代理默认端口从
9092
更改为
9094
时,定制的kafka代理端口出现了问题。只有当我更改回默认端口时,卡夫卡连接才起作用。我的问题是,有没有办法启动kafka connect以连接到定制的kafka端口@KonstantineI已经更新了
/etc/schema registry/connect avro distributed.properties
文件中的boostrap.servers。卡夫卡连接现在正在工作。顺便说一句,关于在zookeeper上启用SSL,我有一个问题,到目前为止,我只看到了从客户端到kafka服务器的连接的SSL设置,并且只看到了inte代理。但对于连接到zookeeper,没有可用的SSL设置,因为这是我们组织中的安全问题。谢谢