Amazon web services `该节点的资源imagefs`不足--导致定期退出pod

我将Jenkins-X用于一个相对较大的项目，该项目由大约30个模块组成，其中15个是服务（因此，包含Dockerfiles和用于部署的相应Helm图表）

在一些相对较大的构建过程中，我会间歇性地（每隔一次构建）看到构建吊舱被逐出，使用

kubectl descripe pod

，我可以进行调查，我注意到吊舱被逐出的原因如下：

节点的资源imagefs不足

完整数据：

Name:         maven-96wmn
Namespace:    jx
Node:         ip-192-168-66-176.eu-west-1.compute.internal/
Start Time:   Tue, 06 Nov 2018 10:22:54 +0000
Labels:       jenkins=slave
              jenkins/jenkins-maven=true
Annotations:  <none>
Status:       Failed
Reason:       Evicted
Message:      The node was low on resource: imagefs.
IP:           
Containers:
  maven:
    Image:      jenkinsxio/builder-maven:0.0.516
    Port:       <none>
    Host Port:  <none>
    Command:
      /bin/sh
      -c
    Args:
      cat
    Limits:
      cpu:     1
      memory:  1Gi
    Requests:
      cpu:     400m
      memory:  512Mi
    Environment:
      JENKINS_SECRET:       131c407141521c0842f62a69004df926be6cb531f9318edf0885aeb96b0662b4
      JENKINS_TUNNEL:       jenkins-agent:50000
      DOCKER_CONFIG:        /home/jenkins/.docker/
      GIT_AUTHOR_EMAIL:     jenkins-x@googlegroups.com
      GIT_COMMITTER_EMAIL:  jenkins-x@googlegroups.com
      GIT_COMMITTER_NAME:   jenkins-x-bot
      _JAVA_OPTIONS:        -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap -Dsun.zip.disableMemoryMapping=true -XX:+UseParallelGC -XX:MinHeapFreeRatio=5 -XX:MaxHeapFreeRatio=10 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -Xms10m -Xmx192m
      GIT_AUTHOR_NAME:      jenkins-x-bot
      JENKINS_NAME:         maven-96wmn
      XDG_CONFIG_HOME:      /home/jenkins
      JENKINS_URL:          http://jenkins:8080
      HOME:                 /home/jenkins
    Mounts:
      /home/jenkins from workspace-volume (rw)
      /home/jenkins/.docker from volume-2 (rw)
      /home/jenkins/.gnupg from volume-3 (rw)
      /root/.m2 from volume-1 (rw)
      /var/run/docker.sock from volume-0 (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from jenkins-token-smvvp (ro)
  jnlp:
    Image:      jenkinsci/jnlp-slave:3.14-1
    Port:       <none>
    Host Port:  <none>
    Args:
      131c407141521c0842f62a69004df926be6cb531f9318edf0885aeb96b0662b4
      maven-96wmn
    Requests:
      cpu:     100m
      memory:  128Mi
    Environment:
      JENKINS_SECRET:       131c407141521c0842f62a69004df926be6cb531f9318edf0885aeb96b0662b4
      JENKINS_TUNNEL:       jenkins-agent:50000
      DOCKER_CONFIG:        /home/jenkins/.docker/
      GIT_AUTHOR_EMAIL:     jenkins-x@googlegroups.com
      GIT_COMMITTER_EMAIL:  jenkins-x@googlegroups.com
      GIT_COMMITTER_NAME:   jenkins-x-bot
      _JAVA_OPTIONS:        -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap -Dsun.zip.disableMemoryMapping=true -XX:+UseParallelGC -XX:MinHeapFreeRatio=5 -XX:MaxHeapFreeRatio=10 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -Xms10m -Xmx192m
      GIT_AUTHOR_NAME:      jenkins-x-bot
      JENKINS_NAME:         maven-96wmn
      XDG_CONFIG_HOME:      /home/jenkins
      JENKINS_URL:          http://jenkins:8080
      HOME:                 /home/jenkins
    Mounts:
      /home/jenkins from workspace-volume (rw)
      /home/jenkins/.docker from volume-2 (rw)
      /home/jenkins/.gnupg from volume-3 (rw)
      /root/.m2 from volume-1 (rw)
      /var/run/docker.sock from volume-0 (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from jenkins-token-smvvp (ro)
Volumes:
  volume-0:
    Type:          HostPath (bare host directory volume)
    Path:          /var/run/docker.sock
    HostPathType:  
  volume-2:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  jenkins-docker-cfg
    Optional:    false
  volume-1:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  jenkins-maven-settings
    Optional:    false
  workspace-volume:
    Type:    EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:  
  volume-3:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  jenkins-release-gpg
    Optional:    false
  jenkins-token-smvvp:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  jenkins-token-smvvp
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type     Reason                 Age   From                                                   Message
  ----     ------                 ----  ----                                                   -------
  Normal   Created                7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  Created container
  Normal   SuccessfulMountVolume  7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "workspace-volume"
  Normal   SuccessfulMountVolume  7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "volume-0"
  Normal   SuccessfulMountVolume  7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "volume-1"
  Normal   SuccessfulMountVolume  7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "volume-2"
  Normal   SuccessfulMountVolume  7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "volume-3"
  Normal   SuccessfulMountVolume  7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "jenkins-token-smvvp"
  Normal   Pulled                 7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  Container image "jenkinsxio/builder-maven:0.0.516" already present on machine
  Normal   Scheduled              7m    default-scheduler                                      Successfully assigned maven-96wmn to ip-192-168-66-176.eu-west-1.compute.internal
  Normal   Started                7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  Started container
  Normal   Pulled                 7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  Container image "jenkinsci/jnlp-slave:3.14-1" already present on machine
  Normal   Created                7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  Created container
  Normal   Started                7m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  Started container
  Warning  Evicted                5m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  The node was low on resource: imagefs.
  Normal   Killing                5m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  Killing container with id docker://jnlp:Need to kill Pod
  Normal   Killing                5m    kubelet, ip-192-168-66-176.eu-west-1.compute.internal  Killing container with id docker://maven:Need to kill Pod

名称：maven-96wmn
名称空间：jx
节点：ip-192-168-66-176.eu-west-1.compute.internal/
开始时间：2018年11月6日星期二10:22:54+0000
标签：詹金斯=奴隶
詹金斯/詹金斯·马文=真
注释：
状态：失败
原因：被驱逐
消息：节点资源imagefs不足。
知识产权：
容器：
马文：
图片：jenkinsxio/builder maven:0.0.516
端口：
主机端口：
命令：
/垃圾箱/垃圾箱
-c
Args：
猫
限制：
中央处理器：1
内存：1Gi
请求：
中央处理器：400米
内存：512Mi
环境：
JENKINS_机密：131c407141521c0842f62a69004df926be6cb531f9318edf0885aeb96b0662b4
詹金斯隧道：詹金斯代理：50000
DOCKER\u CONFIG:/home/jenkins/.DOCKER/
GIT_作者_电子邮件：jenkins-x@googlegroups.com
GIT_提交人电子邮件：jenkins-x@googlegroups.com
GIT_提交人名称：jenkins-x-bot
_JAVA_选项：-XX:+UnlockExperimentalVMOptions-XX:+UseCGroupMemoryLimitForHeap-Dsun.zip.disableMemoryMapping=true-XX:+UseParallelGC-XX:MinHeapFreeRatio=5-XX:MaxHeapFreeRatio=10-XX:GCTimeRatio=4-XX:AdaptiveSizePolicyWeight=90-Xms10m-Xmx192m
GIT_作者姓名：jenkins-x-bot
JENKINS_姓名：maven-96wmn
XDG\u CONFIG\u HOME:/HOME/jenkins
詹金斯大学网址：http://jenkins:8080
HOME:/HOME/jenkins
挂载：
/主页/工作区中的jenkins卷（rw）
/home/jenkins/.docker，第二卷（rw）
/home/jenkins/.gnupg，摘自第3卷（rw）
/第1卷的根/.m2（rw）
/卷-0中的var/run/docker.sock（rw）
/来自jenkins token smvvp（ro）的var/run/secrets/kubernetes.io/serviceCount
jnlp：
图：jenkinsci/jnlp从站：3.14-1
端口：
主机端口：
Args：
131c407141521c0842f62a69004df926be6cb531f9318edf0885aeb96b0662b4
maven-96wmn
请求：
中央处理器：100米
内存：128英里
环境：
JENKINS_机密：131c407141521c0842f62a69004df926be6cb531f9318edf0885aeb96b0662b4
詹金斯隧道：詹金斯代理：50000
DOCKER\u CONFIG:/home/jenkins/.DOCKER/
GIT_作者_电子邮件：jenkins-x@googlegroups.com
GIT_提交人电子邮件：jenkins-x@googlegroups.com
GIT_提交人名称：jenkins-x-bot
_JAVA_选项：-XX:+UnlockExperimentalVMOptions-XX:+UseCGroupMemoryLimitForHeap-Dsun.zip.disableMemoryMapping=true-XX:+UseParallelGC-XX:MinHeapFreeRatio=5-XX:MaxHeapFreeRatio=10-XX:GCTimeRatio=4-XX:AdaptiveSizePolicyWeight=90-Xms10m-Xmx192m
GIT_作者姓名：jenkins-x-bot
JENKINS_姓名：maven-96wmn
XDG\u CONFIG\u HOME:/HOME/jenkins
詹金斯大学网址：http://jenkins:8080
HOME:/HOME/jenkins
挂载：
/主页/工作区中的jenkins卷（rw）
/home/jenkins/.docker，第二卷（rw）
/home/jenkins/.gnupg，摘自第3卷（rw）
/第1卷的根/.m2（rw）
/卷-0中的var/run/docker.sock（rw）
/来自jenkins token smvvp（ro）的var/run/secrets/kubernetes.io/serviceCount
卷数：
第0卷：
类型：主机路径（裸主机目录卷）
路径：/var/run/docker.sock
主机路径类型：
第2卷：
类型：Secret（由Secret填充的卷）
秘书长姓名：詹金斯·多克尔
可选：false
第1卷：
类型：Secret（由Secret填充的卷）
SecretName:jenkins maven设置
可选：false
工作区卷：
类型：EmptyDir（共享pod生存期的临时目录）
中等：
第3卷：
类型：Secret（由Secret填充的卷）
秘书长姓名：詹金斯发布gpg
可选：false
詹金斯令牌smvvp：
类型：Secret（由Secret填充的卷）
机密名称：jenkins token smvvp
可选：false
QoS等级：Burstable
节点选择器：
容差：node.kubernetes.io/未就绪：不执行300秒
node.kubernetes.io/不可访问：不执行300秒
活动：
从消息中键入原因年龄
----     ------                 ----  ----                                                   -------
正常创建的7m kubelet，ip-192-168-66-176.eu-west-1.compute.internal创建的容器
正常成功装入卷7m kubelet，ip-192-168-66-176.eu-west-1.compute.internal MountVolume.volume“工作区卷”的安装成功
正常成功装入卷7m kubelet，ip-192-168-66-176.eu-west-1.compute.internal MountVolume.volume“volume-0”的安装成功
正常成功装入卷7m kubelet，ip-192-168-66-176.eu-west-1.compute.internal MountVolume.SetUp成功装入卷“volume-1”
正常成功装入卷7m kubelet，ip-192-168-66-176.eu-west-1.compute.internal MountVolume.volume“volume-2”的安装成功
正常成功装入卷7m kubelet，ip-192-168-66-176.eu-west-1.compute.internal MountVolume.volume“volume-3”的安装成功
正常成功装入卷7m kubelet，ip-192-168-66-176.eu-west-1.compute.internal MountVolume.SetUp成功装入卷“jenkins token smvvp”
正常库贝莱，i