Flink-StreamingFileLink到s3无法从上一个快照恢复（java.io.FileNotFoundException）

我有一个简单的Flink作业（Flink版本1.8.3），它有一个每10分钟写入s3存储桶的接收器

当我停止作业并从上一个快照重新启动作业时，我经常会遇到这样的错误，使我无法正常恢复作业

  "throwableInformation": [
        "java.io.FileNotFoundException: No such file or directory: s3://my-bucket/2020-09-22--18/_part-0-0_tmp_91f865fe-4774-4699-80ca-483aa36e3fd9",
        "\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2231)",
        "\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2149)",
        "\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2088)",
        "\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.open(S3AFileSystem.java:699)",
        "\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950)",
        "\tat org.apache.flink.fs.s3hadoop.HadoopS3AccessHelper.getObject(HadoopS3AccessHelper.java:98)",
        "\tat org.apache.flink.fs.s3.common.writer.S3RecoverableMultipartUploadFactory.recoverInProgressPart(S3RecoverableMultipartUploadFactory.java:97)",
        "\tat org.apache.flink.fs.s3.common.writer.S3RecoverableMultipartUploadFactory.recoverRecoverableUpload(S3RecoverableMultipartUploadFactory.java:75)",
        "\tat org.apache.flink.fs.s3.common.writer.S3RecoverableWriter.recover(S3RecoverableWriter.java:95)",
        "\tat org.apache.flink.fs.s3.common.writer.S3RecoverableWriter.recover(S3RecoverableWriter.java:50)",
        "\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.restoreInProgressFile(Bucket.java:140)",
        "\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.<init>(Bucket.java:127)",
        "\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.restore(Bucket.java:399)",
        "\tat org.apache.flink.streaming.api.functions.sink.filesystem.DefaultBucketFactoryImpl.restoreBucket(DefaultBucketFactoryImpl.java:64)",
        "\tat org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.handleRestoredBucketState(Buckets.java:177)",
        "\tat org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.initializeActiveBuckets(Buckets.java:165)",
        "\tat org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.initializeState(Buckets.java:149)",
        "\tat org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState(StreamingFileSink.java:334)",
        "\tat org.apache.flink.streaming.util.functions.StreamingFunctionUtils.tryRestoreFunction(StreamingFunctionUtils.java:178)",
        "\tat org.apache.flink.streaming.util.functions.StreamingFunctionUtils.restoreFunctionState(StreamingFunctionUtils.java:160)",
        "\tat org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.initializeState(AbstractUdfStreamOperator.java:96)",
        "\tat org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:278)",
        "\tat org.apache.flink.streaming.runtime.tasks.StreamTask.initializeState(StreamTask.java:763)",
        "\tat org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:297)",
        "\tat org.apache.flink.runtime.taskmanager.Task.run(Task.java:714)",
        "\tat java.lang.Thread.run(Thread.java:748)"
    ],
......
......) -> to: Result -> (Sink: Print to Std. Out, Sink: Unnamed, Sink: Unnamed, Sink: Unnamed) (1/1) (7dc2e0b7013bbfddf507531ebc184c46) switched from RUNNING to FAILED.","throwableInformation":["java.io.FileNotFoundException: No such file or directory: s3://my-bucket/2020-09-22--18/_part-0-0_tmp_91f865fe-4774-4699-80ca-483aa36e3fd9","\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2231)","\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2149)","\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2088)","\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.open(S3AFileSystem.java:699)","\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950)","\tat org.apache.flink.fs.s3hadoop.HadoopS3AccessHelper.getObject(HadoopS3AccessHelper.java:98)","\tat org.apache.flink.fs.s3.common.writer.S3RecoverableMultipartUploadFactory.recoverInProgressPart(S3RecoverableMultipartUploadFactory.java:97)","\tat org.apache.flink.fs.s3.common.writer.S3RecoverableMultipartUploadFactory.recoverRecoverableUpload(S3RecoverableMultipartUploadFactory.java:75)","\tat org.apache.flink.fs.s3.common.writer.S3RecoverableWriter.recover(S3RecoverableWriter.java:95)","\tat org.apache.flink.fs.s3.common.writer.S3RecoverableWriter.recover(S3RecoverableWriter.java:50)","\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.restoreInProgressFile(Bucket.java:140)","\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.<init>(Bucket.java:127)","\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.restore(Bucket.java:399)","\tat org.apache.flink.streaming.api.functions.sink.filesystem.DefaultBucketFactoryImpl.restoreBucket(DefaultBucketFactoryImpl.java:64)","\tat org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.handleRestoredBucketState(Buckets.java:177)","\tat org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.initializeActiveBuckets(Buckets.java:165)","\tat org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.initializeState(Buckets.java:149)","\tat org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState(StreamingFileSink.java:334)","\tat org.apache.flink.streaming.util.functions.StreamingFunctionUtils.tryRestoreFunction(StreamingFunctionUtils.java:178)","\tat org.apache.flink.streaming.util.functions.StreamingFunctionUtils.restoreFunctionState(StreamingFunctionUtils.java:160)","\tat org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.initializeState(AbstractUdfStreamOperator.java:96)","\tat org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:278)","\tat org.apache.flink.streaming.runtime.tasks.StreamTask.initializeState(StreamTask.java:763)","\tat 

“一次性信息”：[
“java.io.FileNotFoundException:没有这样的文件或目录：s3://my bucket/2020-09-22--18/_part-0-0_tmp_91f865fe-4774-4699-80ca-483aa36e3fd9”，
“\tat org.apache.flink.fs.shade.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus（S3AFileSystem.java:2231）”，
“\tat org.apache.flink.fs.shade.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus（S3AFileSystem.java:2149）”，
“\tat org.apache.flink.fs.shade.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus（S3AFileSystem.java:2088）”，
“\tat org.apache.flink.fs.shade.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.open（S3AFileSystem.java:699）”，
“\tat org.apache.flink.fs.shade.hadoop3.org.apache.hadoop.fs.FileSystem.open（FileSystem.java:950）”，
“\tat org.apache.flink.fs.s3hadoop.HadoopS3AccessHelper.getObject（HadoopS3AccessHelper.java:98）”，
“\tat org.apache.flink.fs.s3.common.writer.S3RecoverableMultipartUploadFactory.recoverInProgressPart（S3RecoverableMultipartUploadFactory.java:97）”，
“\tat org.apache.flink.fs.s3.common.writer.s3RecoverableMultipartPloadFactory.RecoverableUpload（s3RecoverableMultipartPloadFactory.java:75）”，
“\tat org.apache.flink.fs.s3.common.writer.S3RecoverableWriter.recover（S3RecoverableWriter.java:95）”，
“\tat org.apache.flink.fs.s3.common.writer.S3RecoverableWriter.recover（S3RecoverableWriter.java:50）”，
“\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.restoreInProgressFile（Bucket.java:140）”，
“\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.（Bucket.java:127）”，
“\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.restore（Bucket.java:399）”，
“\t org.apache.flink.streaming.api.functions.sink.filesystem.DefaultBucketFactoryImpl.restoreBucket（DefaultBucketFactoryImpl.java:64）”，
“\tat org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.handleRestoredBucketState（Buckets.java:177）”，
“\tat org.apache.flink.streaming.api.functions.sink.filesystem.bucket.initializeActiveBuckets（bucket.java:165）”，
“\tat org.apache.flink.streaming.api.functions.sink.filesystem.bucket.initializeState（bucket.java:149）”，
“\tat org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState（StreamingFileSink.java:334）”，
“\tat org.apache.flink.streaming.util.functions.StreamingFunctionUtils.tryRestoreFunction（StreamingFunctionUtils.java:178）”，
“\tat org.apache.flink.streaming.util.functions.StreamingFunctionUtils.restoreFunctionState（StreamingFunctionUtils.java:160）”，
“\tat org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.initializeState（AbstractUdfStreamOperator.java:96）”，
“\tat org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState（AbstractStreamOperator.java:278）”，
“\tat org.apache.flink.streaming.runtime.tasks.StreamTask.initializeState（StreamTask.java:763）”，
“\tat org.apache.flink.streaming.runtime.tasks.StreamTask.invoke（StreamTask.java:297）”，
“\tat org.apache.flink.runtime.taskmanager.Task.run（Task.java:714）”，
“\tat java.lang.Thread.run（Thread.java:748）”
],
......
…至：结果->（接收器：打印到标准输出，接收器：未命名，接收器：未命名，接收器：未命名）（1/1）（7dc2e0b7013bbfddf507531ebc184c46）从运行切换到失败。“，“throwableInformation:”[“java.io.FileNotFoundException:无此类文件或目录：s3://my bucket/2020-09-22--18/_part-0-0_tmp_91f865fe-4774-4699-80ca-483aa36e3fd9“，”\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus（S3AFileSystem.java:2231）”，“\tat org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus（S3AFileSystem.java:2149）”，“\tat org.apache.flink.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus“\tat org.apache.flink.fs.shade.hadoop.org.apache.hadoop.fs.s3a.S3AFileSystem.open（S3AFileSystem.java:699）”，“\tat org.apache.flink.fs.shade.hadoop.org.apache.hadoop.fs.FileSystem.open（FileSystem.java:950）”，“\tat org.apache.flink.fs.fs.s3hadoop.HadoopS3AccessHelper.getObject（HadoopS3AccessHelper.java:98）”，”\tat org.apache.flink.fs.s3.common.writer.S3RecoverableMultipartUploadFactory.recoverInProgressPart（S3RecoverableMultipartUploadFactory.java:97）”，“\tat org.apache.flink.fs.s3.common.writer.s3recoverablemultipartupload（S3RecoverableMultipartUploadFactory.java:75）”，”\tat org.apache.flink.fs.s3.common.writer.S3RecoverableWriter.recover（S3RecoverableWriter.java:95）”，“\tat org.apache.flink.fs.s3.common.writer.recover（S3RecoverableWriter.java:50）”，“\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.restoreInProgressFile（Bucket.java:140）”，”\tat org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.（Bucket.java:127）”，“\tat org.apache.flink.streaming.api.functions.sink.Bucket.restore（Bucket.java:399）”，“\tat org.apache.flink.streaming.api.functions.sink.filesystem.DefaultBucketFactoryImpl.restoreBucket（DefaultBucketFactoryImpl.java:64）”，”\tat org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.handleRestoredBucketState（Buckets.java:177）”，“\tat org.apache.flink.streaming.api.functions.Buckets.initializeATivebuckets（Buckets.java:165）”，“\tat org.apache.flink.flink.filesystem.Buckets.initializeState（Buckets.java:149）”，”\tat org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.i