Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/apache-kafka/3.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache kafka 卡夫卡连接路径格式工作不正常_Apache Kafka_Apache Kafka Connect_S3 Kafka Connector - Fatal编程技术网

Apache kafka 卡夫卡连接路径格式工作不正常

Apache kafka 卡夫卡连接路径格式工作不正常,apache-kafka,apache-kafka-connect,s3-kafka-connector,Apache Kafka,Apache Kafka Connect,S3 Kafka Connector,我使用下面的脚本创建连接器,但在S3中,我看到分区格式为/year=2015/month=12/day=07/hour=15/。有没有办法实现'dt'=YYYY-MM-dd/'hour'=HH/格式的分区 curl -X POST \ -H "Content-Type: application/json" \ --data '{ "name": "content.logging.test", "

我使用下面的脚本创建连接器,但在S3中,我看到分区格式为/year=2015/month=12/day=07/hour=15/。有没有办法实现'dt'=YYYY-MM-dd/'hour'=HH/格式的分区

curl -X POST \
    -H "Content-Type: application/json" \
    --data '{
    "name": "content.logging.test",
    "config": {
        "topics": "content.logging",
        "connector.class": "io.confluent.connect.s3.S3SinkConnector",
        "storage.class": "io.confluent.connect.s3.storage.S3Storage",
        "format.class": "io.confluent.connect.s3.format.json.JsonFormat",
        "s3.region": "ap-northeast-1",
        "s3.bucket.name": "kafka-connect-test",
        "locale": "en-US",
        "timezone": "UTC",
        "tasks.max": 1,
        "flush.size": 10,
        "partitioner.class": "io.confluent.connect.storage.partitioner.HourlyPartitioner",
        "partition.duration.ms": 3600000,
        "path.format": "'dt'=YYYY-MM-dd/'hour'=HH/"
        }
    }' http://$CONNECT_REST_ADVERTISED_HOST_NAME:8083/connectors

如果要使用格式,则应使用TimeBasedPartitioner