Apache kafka Kafka接收器:由于错误而停止时出错(org.apache.Kafka.connect.cli.ConnectStandalone:130)

Apache kafka Kafka接收器:由于错误而停止时出错(org.apache.Kafka.connect.cli.ConnectStandalone:130),apache-kafka,apache-kafka-connect,confluent-platform,confluent-schema-registry,Apache Kafka,Apache Kafka Connect,Confluent Platform,Confluent Schema Registry,我正在尝试将数据从一个流文件流到另一个文件。它在更早的时候工作,突然它提供了一个错误作为由于错误而停止的错误(org.apache.kafka.connect.cli.ConnectStandalone:130)。已重新启动zookeeper、kafka服务器、架构注册表、源和接收器连接器,但仍面临相同的问题,无法解决。任何建议都会有帮助 源连接器: name=local-file-source connector.class=FileStreamSource tasks.max=1 file=

我正在尝试将数据从一个流文件流到另一个文件。它在更早的时候工作,突然它提供了一个错误作为
由于错误而停止的错误(org.apache.kafka.connect.cli.ConnectStandalone:130)
。已重新启动zookeeper、kafka服务器、架构注册表、源和接收器连接器,但仍面临相同的问题,无法解决。任何建议都会有帮助

源连接器:

name=local-file-source
connector.class=FileStreamSource
tasks.max=1
file=/home/jimmacaulay/Desktop/ETL/Kafka/confluent-5.5.1/data/data/Jim_Source.csv
topic=Jim
name=local-file-sink
connector.class=FileStreamSink
tasks.max=1
file=/home/jimmacaulay/Desktop/ETL/Kafka/confluent-5.5.1/data/data/Jim_Sink.csv
topics=Jim
水槽连接器:

name=local-file-source
connector.class=FileStreamSource
tasks.max=1
file=/home/jimmacaulay/Desktop/ETL/Kafka/confluent-5.5.1/data/data/Jim_Source.csv
topic=Jim
name=local-file-sink
connector.class=FileStreamSink
tasks.max=1
file=/home/jimmacaulay/Desktop/ETL/Kafka/confluent-5.5.1/data/data/Jim_Sink.csv
topics=Jim
错误:

[2020-08-18 06:25:50,482] ERROR Stopping due to error (org.apache.kafka.connect.cli.ConnectStandalone:130)
org.apache.kafka.connect.errors.ConnectException: Unable to initialize REST server
    at org.apache.kafka.connect.runtime.rest.RestServer.initializeServer(RestServer.java:217)
    at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:87)
Caused by: java.io.IOException: Failed to bind to 0.0.0.0/0.0.0.0:8083
    at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:346)
    at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:307)
    at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
    at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:231)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72)
    at org.eclipse.jetty.server.Server.doStart(Server.java:385)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72)
    at org.apache.kafka.connect.runtime.rest.RestServer.initializeServer(RestServer.java:215)
    ... 1 more
Caused by: java.net.BindException: Address already in use
    at sun.nio.ch.Net.bind0(Native Method)
    at sun.nio.ch.Net.bind(Net.java:433)
    at sun.nio.ch.Net.bind(Net.java:425)
    at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:220)
    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85)
    at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:342)
    ... 8 more

通过同时使用源和接收器属性启动
connectstandalone
,解决了此错误

sh connect-standalone ../config/connect-avro-standalone.properties ../config/connect-file-source_Topic_Jim.properties ../config/connect-file-sink_Topic_Jim.properties
早些时候,我单独启动了它,如下所示

sh connect-standalone ../config/connect-avro-standalone.properties ../config/connect-file-source_Topic_Jim.properties

sh connect-standalone ../config/connect-avro-standalone.properties ../config/connect-file-sink_Topic_Jim.properties
问题的起因,

当am单独启动时,
connectstandalone
首先使用端口号8083启动源属性。同样,当我启动接收器属性时,它尝试使用相同的端口号并失败

解决方案

在启动共享同一端口的独立连接时,源和接收器属性都应保持一致


或者在属性文件中定义不同的端口号并分别启动它

,或者使用connect distributed,它在一个端口上启动单个REST服务器,您可以在其中运行两个连接器