Amazon s3 将带有蒸汽文件接收器的Flink 1.9迁移到S3不起作用

我正在尝试使用Kafka消费源，将流式文件接收器用于S3

final StreamingFileSink<String> sink = StreamingFileSink
        .forRowFormat(new Path(“s3a://test/test”), new SimpleStringEncoder("UTF-8"))
        .withBucketAssigner(new DateTimeBucketAssigner(outputBucketFormat))
        .withRollingPolicy(rollingPolicy)
        .build();

S3是否需要任何附加配置？使用Flink版本1.9.0和1.9.1进行测试

---

找到了，但即使将flink-s3-fs-hadoop jar放在lib下也不起作用。请让我知道docker hub上是否有任何可用的flink映像的工作配置

是否启用了检查点？使用流文件接收器时必须设置检查点。是否启用了检查点？对于使用流文件接收器，必须设置检查点。

2020-01-06 23:51:47,237 INFO  org.apache.flink.fs.shaded.hadoop3.org.apache.commons.beanutils.FluentPropertyBeanIntrospector - 
Error when creating PropertyDescriptor for public final void org.apache.flink.fs.shaded.hadoop3.org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property.

2020-01-06 23:51:47,249 WARN  org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.metrics2.impl.MetricsConfig - 
Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties

2020-01-06 23:51:47,275 INFO  org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.metrics2.impl.MetricsSystemImpl - 
Scheduled Metric snapshot period at 10 second(s).

2020-01-06 23:51:47,276 INFO  org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.metrics2.impl.MetricsSystemImpl - 
s3a-file-system metrics system started