Apache kafka 转换是否在confluent.cloud(卡夫卡)到elastic cloud中工作
我正在confluent.cloud(卡夫卡)中创建弹性水槽连接器。在这里,如果我使用转换,它将不起作用。will confluent.cloud(卡夫卡)支持转换吗 下面是我的剧本Apache kafka 转换是否在confluent.cloud(卡夫卡)到elastic cloud中工作,apache-kafka,apache-kafka-connect,elastic-cloud,confluent-cloud,Apache Kafka,Apache Kafka Connect,Elastic Cloud,Confluent Cloud,我正在confluent.cloud(卡夫卡)中创建弹性水槽连接器。在这里,如果我使用转换,它将不起作用。will confluent.cloud(卡夫卡)支持转换吗 下面是我的剧本 { "name": "ElasticConnectorTest5", "config": { "topics": "enterprise.contact6.model",
{
"name": "ElasticConnectorTest5",
"config": {
"topics": "enterprise.contact6.model",
"input.data.format": "AVRO",
"connector.class": "ElasticsearchSink",
"name": "ElasticConnectorTest5",
"kafka.api.key": "xxxxxxxxxxxxx",
"kafka.api.secret": "xxxxxxxxxxxxxxxxxx",
"connection.url": "url",
"connection.username": "**********",
"connection.password": "*********",
"type.name": "_doc",
"key.ignore": "false",
"schema.ignore": "true",
"tasks.max": "1",
"errors.tolerance": "all",
"errors.log.enable": "true",
"errors.log.include.messages": "true",
"behavior.on.malformed.documents": "warn",
"transforms": "InsertMetadata,IndexName",
"transforms.InsertMetadata.type": "org.apache.kafka.connect.transforms.InsertField$Value",
"transforms.InsertMetadata.partition.field": "partition",
"transforms.InsertMetadata.offset.field": "offset",
"transforms.IndexName.type": "org.apache.kafka.connect.transforms.RegexRouter",
"transforms.IndexName.regex": "enterprise.(.*)",
"transforms.IndexName.replacement": "es.$1"
}
}
Confluent Cloud目前(2021年5月)不支持单一消息转换
您需要使用类似于ksqlDB或Kafka流的东西来预处理数据。有趣。。。因此,如果它们根本不可用,那么这意味着连接类路径将从内置转换中剥离?