elasticsearch,apache-flink,Scala,elasticsearch,Apache Flink" /> elasticsearch,apache-flink,Scala,elasticsearch,Apache Flink" />

Scala Flink elasticsearch连接器失败,异常未知设置[bulk.flush.max.size.mb]

Scala Flink elasticsearch连接器失败,异常未知设置[bulk.flush.max.size.mb],scala,elasticsearch,apache-flink,Scala,elasticsearch,Apache Flink,Flink 1.5.0 ElasticSearch连接器具有以下代码 Map<String, String> config = new HashMap<>(); config.put("cluster.name", "my-cluster-name"); // This instructs the sink to emit after every element, otherwise they would be buffered config.put("bulk.flus

Flink 1.5.0 ElasticSearch连接器具有以下代码

Map<String, String> config = new HashMap<>();
config.put("cluster.name", "my-cluster-name");
// This instructs the sink to emit after every element, otherwise they would be buffered
config.put("bulk.flush.max.actions", "1");
这是我得到的一个例外

Exception in thread "main" org.apache.flink.runtime.client.JobExecutionException: java.lang.IllegalArgumentException: unknown setting [bulk.flush.max.size.mb] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
    at org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:625)
    at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:121)
    at org.apache.flink.streaming.api.scala.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.scala:654)
    at org.myorg.quickstart.StreamingKafkaClient$.main(StreamingKafkaClient.scala:63)
    at org.myorg.quickstart.StreamingKafkaClient.main(StreamingKafkaClient.scala)
另外,似乎Fink connector不适用于ES 6.x,我必须卸载并移回ES 5.x才能使Flink-to-ES连接正常工作。我想使用bulk.flush.max.actions,因为我怀疑事件正在被缓冲,并且在一段时间后没有被推送到ES(或者可能发生了另一个问题,但这超出了此问题的范围)

我使用的是Flink 1.5.0,pom.xml的相关摘录如下

    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-connector-elasticsearch5_2.11</artifactId>
        <version>1.5.0</version>
    </dependency>

org.apache.flink
flink-connector-elasticsearch5_2.11
1.5.0

为什么使用bulk.flush.max.size.mb而不是bulk.flush.max.actions?我也尝试过使用它(事实上,这是我最初使用的,因为这是Flink文档中使用的),同样的错误。
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-connector-elasticsearch5_2.11</artifactId>
        <version>1.5.0</version>
    </dependency>