Apache flink Flink群集启动错误：无法解析ResourceManager地址akka_Apache Flink_Flink Streaming_Docker Desktop_Flink Cep_Flink Sql

Apache flink Flink群集启动错误：无法解析ResourceManager地址akka

apache-flink

Apache flink Flink群集启动错误：无法解析ResourceManager地址akka,apache-flink,flink-streaming,docker-desktop,flink-cep,flink-sql,Apache Flink,Flink Streaming,Docker Desktop,Flink Cep,Flink Sql,需要以下错误的帮助，因为我似乎找不到实际问题。我正在尝试在win10 professional的docker桌面上运行flink cluster Dockerfile: FROM container-registry.ubs.net/flink:1.11 ADD build/libs/demoapp-service-all.jar /opt/flink/usrlib/demoapp-service-all.jar volume /tmp ADD conf/flink-conf.yaml /opt

需要以下错误的帮助，因为我似乎找不到实际问题。我正在尝试在win10 professional的docker桌面上运行flink cluster

Dockerfile:

FROM container-registry.ubs.net/flink:1.11
ADD build/libs/demoapp-service-all.jar /opt/flink/usrlib/demoapp-service-all.jar
volume /tmp
ADD conf/flink-conf.yaml /opt/flink/conf/flink-conf.yaml
ADD conf/log4j.properties /opt/flink/conf/log4j.properties

jobmanager.rpc.address: jobmanager
jobmanager.rpc.port: 8092
jobmanager.memory.process.size: 1600m
taskmanager.memory.process.size: 1728m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
state.backend: rocksdb
state.checkpoints.dir: file:///c:/Users/demo/checkpoint_dir
state.backend.rocksdb.memory.managed: true

version: "2.2"
services:
  jobmanager:
    image: demo/demoapp:1.0
    ports:
      - "8092:8092"
    command: ["standalone-job", "-Dspring.profiles.active=dev"]


  taskmanager:
    image: demo/demoapp:1.0
    depends_on:
      - jobmanager
    command: ["taskmanager", "-Dspring.profiles.active=dev"]
    scale: 1

jobmanager_1   | Starting Job Manager
taskmanager_1  | Starting Task Manager
jobmanager_1   | Starting standalonejob as a console application on host aaf9a34c154f.
taskmanager_1  | Starting taskexecutor as a console application on host a96dd08d9ae6.
---------------------------------------------------------------------------------------------
taskmanager_1  | TM_RESOURCE_PARAMS extraction logs:
taskmanager_1  | jvm_params: -Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=268435456
taskmanager_1  | dynamic_configs: -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.network.min=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.cpu.cores=2.0 -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.memory.task.off-heap.size=0b
taskmanager_1  | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, a96dd08d9ae6
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
taskmanager_1  | INFO  [] - Loading configuration property: parallelism.default, 1
taskmanager_1  | INFO  [] - Loading configuration property: state.backend, rocksdb
taskmanager_1  | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
taskmanager_1  | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
taskmanager_1  | INFO  [] - Loading configuration property: blob.server.port, 6124
taskmanager_1  | INFO  [] - Loading configuration property: query.server.port, 6125
-------------------------------------------------------------------------------------- 
jobmanager_1   | JM_RESOURCE_PARAMS extraction logs:
jobmanager_1   | jvm_params: -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456
jobmanager_1   | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, aaf9a34c154f
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
jobmanager_1   | INFO  [] - Loading configuration property: parallelism.default, 1
jobmanager_1   | INFO  [] - Loading configuration property: state.backend, rocksdb
jobmanager_1   | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
jobmanager_1   | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
jobmanager_1   | INFO  [] - Loading configuration property: blob.server.port, 6124
jobmanager_1   | INFO  [] - Loading configuration property: query.server.port, 6125
---------------------------------------------------------------------------------------------

taskmanager_1  | 2020-11-25 10:15:41,179 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Trying to connect to address a96dd08d9ae6/172.18.0.3:8092
taskmanager_1  | 2020-11-25 10:15:41,180 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address 'a96dd08d9ae6/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,182 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)

taskmanager_1  | 2020-11-25 10:16:19,730 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] 
- Could not resolve ResourceManager address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*.

flink-conf.yaml:

FROM container-registry.ubs.net/flink:1.11
ADD build/libs/demoapp-service-all.jar /opt/flink/usrlib/demoapp-service-all.jar
volume /tmp
ADD conf/flink-conf.yaml /opt/flink/conf/flink-conf.yaml
ADD conf/log4j.properties /opt/flink/conf/log4j.properties

jobmanager.rpc.address: jobmanager
jobmanager.rpc.port: 8092
jobmanager.memory.process.size: 1600m
taskmanager.memory.process.size: 1728m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
state.backend: rocksdb
state.checkpoints.dir: file:///c:/Users/demo/checkpoint_dir
state.backend.rocksdb.memory.managed: true

version: "2.2"
services:
  jobmanager:
    image: demo/demoapp:1.0
    ports:
      - "8092:8092"
    command: ["standalone-job", "-Dspring.profiles.active=dev"]


  taskmanager:
    image: demo/demoapp:1.0
    depends_on:
      - jobmanager
    command: ["taskmanager", "-Dspring.profiles.active=dev"]
    scale: 1

jobmanager_1   | Starting Job Manager
taskmanager_1  | Starting Task Manager
jobmanager_1   | Starting standalonejob as a console application on host aaf9a34c154f.
taskmanager_1  | Starting taskexecutor as a console application on host a96dd08d9ae6.
---------------------------------------------------------------------------------------------
taskmanager_1  | TM_RESOURCE_PARAMS extraction logs:
taskmanager_1  | jvm_params: -Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=268435456
taskmanager_1  | dynamic_configs: -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.network.min=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.cpu.cores=2.0 -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.memory.task.off-heap.size=0b
taskmanager_1  | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, a96dd08d9ae6
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
taskmanager_1  | INFO  [] - Loading configuration property: parallelism.default, 1
taskmanager_1  | INFO  [] - Loading configuration property: state.backend, rocksdb
taskmanager_1  | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
taskmanager_1  | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
taskmanager_1  | INFO  [] - Loading configuration property: blob.server.port, 6124
taskmanager_1  | INFO  [] - Loading configuration property: query.server.port, 6125
-------------------------------------------------------------------------------------- 
jobmanager_1   | JM_RESOURCE_PARAMS extraction logs:
jobmanager_1   | jvm_params: -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456
jobmanager_1   | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, aaf9a34c154f
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
jobmanager_1   | INFO  [] - Loading configuration property: parallelism.default, 1
jobmanager_1   | INFO  [] - Loading configuration property: state.backend, rocksdb
jobmanager_1   | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
jobmanager_1   | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
jobmanager_1   | INFO  [] - Loading configuration property: blob.server.port, 6124
jobmanager_1   | INFO  [] - Loading configuration property: query.server.port, 6125
---------------------------------------------------------------------------------------------

taskmanager_1  | 2020-11-25 10:15:41,179 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Trying to connect to address a96dd08d9ae6/172.18.0.3:8092
taskmanager_1  | 2020-11-25 10:15:41,180 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address 'a96dd08d9ae6/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,182 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)

taskmanager_1  | 2020-11-25 10:16:19,730 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] 
- Could not resolve ResourceManager address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*.

我正在从docker文件手动创建“demo/demoapp:1.0”图像，然后启动flink cluster作为“docker compose up”

docker compose.yml:

FROM container-registry.ubs.net/flink:1.11
ADD build/libs/demoapp-service-all.jar /opt/flink/usrlib/demoapp-service-all.jar
volume /tmp
ADD conf/flink-conf.yaml /opt/flink/conf/flink-conf.yaml
ADD conf/log4j.properties /opt/flink/conf/log4j.properties

jobmanager.rpc.address: jobmanager
jobmanager.rpc.port: 8092
jobmanager.memory.process.size: 1600m
taskmanager.memory.process.size: 1728m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
state.backend: rocksdb
state.checkpoints.dir: file:///c:/Users/demo/checkpoint_dir
state.backend.rocksdb.memory.managed: true

version: "2.2"
services:
  jobmanager:
    image: demo/demoapp:1.0
    ports:
      - "8092:8092"
    command: ["standalone-job", "-Dspring.profiles.active=dev"]


  taskmanager:
    image: demo/demoapp:1.0
    depends_on:
      - jobmanager
    command: ["taskmanager", "-Dspring.profiles.active=dev"]
    scale: 1

jobmanager_1   | Starting Job Manager
taskmanager_1  | Starting Task Manager
jobmanager_1   | Starting standalonejob as a console application on host aaf9a34c154f.
taskmanager_1  | Starting taskexecutor as a console application on host a96dd08d9ae6.
---------------------------------------------------------------------------------------------
taskmanager_1  | TM_RESOURCE_PARAMS extraction logs:
taskmanager_1  | jvm_params: -Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=268435456
taskmanager_1  | dynamic_configs: -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.network.min=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.cpu.cores=2.0 -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.memory.task.off-heap.size=0b
taskmanager_1  | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, a96dd08d9ae6
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
taskmanager_1  | INFO  [] - Loading configuration property: parallelism.default, 1
taskmanager_1  | INFO  [] - Loading configuration property: state.backend, rocksdb
taskmanager_1  | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
taskmanager_1  | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
taskmanager_1  | INFO  [] - Loading configuration property: blob.server.port, 6124
taskmanager_1  | INFO  [] - Loading configuration property: query.server.port, 6125
-------------------------------------------------------------------------------------- 
jobmanager_1   | JM_RESOURCE_PARAMS extraction logs:
jobmanager_1   | jvm_params: -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456
jobmanager_1   | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, aaf9a34c154f
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
jobmanager_1   | INFO  [] - Loading configuration property: parallelism.default, 1
jobmanager_1   | INFO  [] - Loading configuration property: state.backend, rocksdb
jobmanager_1   | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
jobmanager_1   | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
jobmanager_1   | INFO  [] - Loading configuration property: blob.server.port, 6124
jobmanager_1   | INFO  [] - Loading configuration property: query.server.port, 6125
---------------------------------------------------------------------------------------------

taskmanager_1  | 2020-11-25 10:15:41,179 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Trying to connect to address a96dd08d9ae6/172.18.0.3:8092
taskmanager_1  | 2020-11-25 10:15:41,180 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address 'a96dd08d9ae6/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,182 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)

taskmanager_1  | 2020-11-25 10:16:19,730 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] 
- Could not resolve ResourceManager address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*.

日志：

FROM container-registry.ubs.net/flink:1.11
ADD build/libs/demoapp-service-all.jar /opt/flink/usrlib/demoapp-service-all.jar
volume /tmp
ADD conf/flink-conf.yaml /opt/flink/conf/flink-conf.yaml
ADD conf/log4j.properties /opt/flink/conf/log4j.properties

jobmanager.rpc.address: jobmanager
jobmanager.rpc.port: 8092
jobmanager.memory.process.size: 1600m
taskmanager.memory.process.size: 1728m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
state.backend: rocksdb
state.checkpoints.dir: file:///c:/Users/demo/checkpoint_dir
state.backend.rocksdb.memory.managed: true

version: "2.2"
services:
  jobmanager:
    image: demo/demoapp:1.0
    ports:
      - "8092:8092"
    command: ["standalone-job", "-Dspring.profiles.active=dev"]


  taskmanager:
    image: demo/demoapp:1.0
    depends_on:
      - jobmanager
    command: ["taskmanager", "-Dspring.profiles.active=dev"]
    scale: 1

jobmanager_1   | Starting Job Manager
taskmanager_1  | Starting Task Manager
jobmanager_1   | Starting standalonejob as a console application on host aaf9a34c154f.
taskmanager_1  | Starting taskexecutor as a console application on host a96dd08d9ae6.
---------------------------------------------------------------------------------------------
taskmanager_1  | TM_RESOURCE_PARAMS extraction logs:
taskmanager_1  | jvm_params: -Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=268435456
taskmanager_1  | dynamic_configs: -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.network.min=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.cpu.cores=2.0 -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.memory.task.off-heap.size=0b
taskmanager_1  | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, a96dd08d9ae6
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
taskmanager_1  | INFO  [] - Loading configuration property: parallelism.default, 1
taskmanager_1  | INFO  [] - Loading configuration property: state.backend, rocksdb
taskmanager_1  | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
taskmanager_1  | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
taskmanager_1  | INFO  [] - Loading configuration property: blob.server.port, 6124
taskmanager_1  | INFO  [] - Loading configuration property: query.server.port, 6125
-------------------------------------------------------------------------------------- 
jobmanager_1   | JM_RESOURCE_PARAMS extraction logs:
jobmanager_1   | jvm_params: -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456
jobmanager_1   | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, aaf9a34c154f
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
jobmanager_1   | INFO  [] - Loading configuration property: parallelism.default, 1
jobmanager_1   | INFO  [] - Loading configuration property: state.backend, rocksdb
jobmanager_1   | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
jobmanager_1   | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
jobmanager_1   | INFO  [] - Loading configuration property: blob.server.port, 6124
jobmanager_1   | INFO  [] - Loading configuration property: query.server.port, 6125
---------------------------------------------------------------------------------------------

taskmanager_1  | 2020-11-25 10:15:41,179 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Trying to connect to address a96dd08d9ae6/172.18.0.3:8092
taskmanager_1  | 2020-11-25 10:15:41,180 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address 'a96dd08d9ae6/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,182 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)

taskmanager_1  | 2020-11-25 10:16:19,730 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] 
- Could not resolve ResourceManager address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*.

错误日志：

FROM container-registry.ubs.net/flink:1.11
ADD build/libs/demoapp-service-all.jar /opt/flink/usrlib/demoapp-service-all.jar
volume /tmp
ADD conf/flink-conf.yaml /opt/flink/conf/flink-conf.yaml
ADD conf/log4j.properties /opt/flink/conf/log4j.properties

jobmanager.rpc.address: jobmanager
jobmanager.rpc.port: 8092
jobmanager.memory.process.size: 1600m
taskmanager.memory.process.size: 1728m
taskmanager.numberOfTaskSlots: 1
parallelism.default: 1
state.backend: rocksdb
state.checkpoints.dir: file:///c:/Users/demo/checkpoint_dir
state.backend.rocksdb.memory.managed: true

version: "2.2"
services:
  jobmanager:
    image: demo/demoapp:1.0
    ports:
      - "8092:8092"
    command: ["standalone-job", "-Dspring.profiles.active=dev"]


  taskmanager:
    image: demo/demoapp:1.0
    depends_on:
      - jobmanager
    command: ["taskmanager", "-Dspring.profiles.active=dev"]
    scale: 1

jobmanager_1   | Starting Job Manager
taskmanager_1  | Starting Task Manager
jobmanager_1   | Starting standalonejob as a console application on host aaf9a34c154f.
taskmanager_1  | Starting taskexecutor as a console application on host a96dd08d9ae6.
---------------------------------------------------------------------------------------------
taskmanager_1  | TM_RESOURCE_PARAMS extraction logs:
taskmanager_1  | jvm_params: -Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=268435456
taskmanager_1  | dynamic_configs: -D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.network.min=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.cpu.cores=2.0 -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.memory.task.off-heap.size=0b
taskmanager_1  | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, a96dd08d9ae6
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
taskmanager_1  | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
taskmanager_1  | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
taskmanager_1  | INFO  [] - Loading configuration property: parallelism.default, 1
taskmanager_1  | INFO  [] - Loading configuration property: state.backend, rocksdb
taskmanager_1  | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
taskmanager_1  | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
taskmanager_1  | INFO  [] - Loading configuration property: blob.server.port, 6124
taskmanager_1  | INFO  [] - Loading configuration property: query.server.port, 6125
-------------------------------------------------------------------------------------- 
jobmanager_1   | JM_RESOURCE_PARAMS extraction logs:
jobmanager_1   | jvm_params: -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456
jobmanager_1   | logs: INFO  [] - Loading configuration property: jobmanager.rpc.address, aaf9a34c154f
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.rpc.port, 8092
jobmanager_1   | INFO  [] - Loading configuration property: jobmanager.memory.process.size, 1600m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.memory.process.size, 1728m
jobmanager_1   | INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
jobmanager_1   | INFO  [] - Loading configuration property: parallelism.default, 1
jobmanager_1   | INFO  [] - Loading configuration property: state.backend, rocksdb
jobmanager_1   | INFO  [] - Loading configuration property: state.checkpoints.dir, file:///c:/Users/demo/checkpoint_dir
jobmanager_1   | INFO  [] - Loading configuration property: state.backend.rocksdb.memory.managed, true
jobmanager_1   | INFO  [] - Loading configuration property: blob.server.port, 6124
jobmanager_1   | INFO  [] - Loading configuration property: query.server.port, 6125
---------------------------------------------------------------------------------------------

taskmanager_1  | 2020-11-25 10:15:41,179 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Trying to connect to address a96dd08d9ae6/172.18.0.3:8092
taskmanager_1  | 2020-11-25 10:15:41,180 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address 'a96dd08d9ae6/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,181 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,182 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/172.18.0.3': Connection refused (Connection refused)
taskmanager_1  | 2020-11-25 10:15:41,183 INFO  org.apache.flink.runtime.net.ConnectionUtils                 [] - Failed to connect from address '/127.0.0.1': Connection refused (Connection refused)

taskmanager_1  | 2020-11-25 10:16:19,730 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] 
- Could not resolve ResourceManager address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@a96dd08d9ae6:8092/user/rpc/resourcemanager_*.

此外，除了错误之外，我无法从日志中理解为什么taskmanager读取的“jobmanager.rpc.address”和“taskmanager.numberOfTaskSlots”与flink-conf.yaml不同。而JobManager读取正确

请帮我解释一下这里缺少的内容。

不是在

flink-conf.yaml

中定义

jobmanager.rpc.address

，而是在

docker compose.yml

文件中定义它解决了我的问题：

Dockerfile

：

FROM flink:1.12.2-scala_2.12-java8

COPY --chown=flink:flink ./path/to/assembly.jar /opt/flink/usrlib/

COPY --chown=flink:flink ./conf/* /opt/flink/conf/

docker compose.yml

：

环境：
弗林克酒店：|-
jobmanager.rpc.address:jobmanager

flink-conf.yaml

：

#其他配置。
# ...
#最后一行留空。

在

flink-conf.yaml

中定义

jobmanager.rpc.address

而不是在

docker compose.yml

文件中定义它解决了我的问题：

Dockerfile

：

FROM flink:1.12.2-scala_2.12-java8

COPY --chown=flink:flink ./path/to/assembly.jar /opt/flink/usrlib/

COPY --chown=flink:flink ./conf/* /opt/flink/conf/

docker compose.yml

：

环境：
弗林克酒店：|-
jobmanager.rpc.address:jobmanager

flink-conf.yaml

：

#其他配置。
# ...
#最后一行留空。