Kubernetes Istio Prometheus吊舱处于紧急后退状态

我正在尝试为他们网站上提供的bookinfo示例设置Istio（1.5.4）。我已经使用了演示配置文件。但在验证istio安装时，它失败了，因为普罗米修斯吊舱已进入紧急回退状态

   NAME                                   READY   STATUS             RESTARTS   AGE
grafana-5f6f8cbf75-psk78               1/1     Running            0          21m
istio-egressgateway-7f9f45c966-g7k9j   1/1     Running            0          21m
istio-ingressgateway-968d69c8b-bhxk5   1/1     Running            0          21m
istio-tracing-9dd6c4f7c-7fm79          1/1     Running            0          21m
istiod-86884c8c45-sw96x                1/1     Running            0          21m
kiali-869c6894c5-wqgjb                 1/1     Running            0          21m
prometheus-589c44dbfc-xkwmj            1/2     CrashLoopBackOff   8          21m

普罗米修斯吊舱的日志：

level=warn ts=2020-05-15T09:07:53.113Z caller=main.go:283 deprecation_notice="'storage.tsdb.retention' flag is deprecated use 'storage.tsdb.retention.time' instead."
level=info ts=2020-05-15T09:07:53.114Z caller=main.go:330 msg="Starting Prometheus" version="(version=2.15.1, branch=HEAD, revision=8744510c6391d3ef46d8294a7e1f46e57407ab13)"
level=info ts=2020-05-15T09:07:53.114Z caller=main.go:331 build_context="(go=go1.13.5, user=root@4b1e33c71b9d, date=20191225-01:04:15)"
level=info ts=2020-05-15T09:07:53.114Z caller=main.go:332 host_details="(Linux 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 prometheus-589c44dbfc-xkwmj (none))"
level=info ts=2020-05-15T09:07:53.114Z caller=main.go:333 fd_limits="(soft=1048576, hard=1048576)"
level=info ts=2020-05-15T09:07:53.114Z caller=main.go:334 vm_limits="(soft=unlimited, hard=unlimited)"
level=error ts=2020-05-15T09:07:53.157Z caller=query_logger.go:107 component=activeQueryTracker msg="Failed to create directory for logging active queries"
level=error ts=2020-05-15T09:07:53.157Z caller=query_logger.go:85 component=activeQueryTracker msg="Error opening query log file" file=data/queries.active err="open data/queries.active: no such file or directory"
panic: Unable to create mmap-ed active query log

goroutine 1 [running]:
github.com/prometheus/prometheus/promql.NewActiveQueryTracker(0x24dda5b, 0x5, 0x14, 0x2c62100, 0xc0005f63c0, 0x2c62100)
    /app/promql/query_logger.go:115 +0x48c
main.main()
    /app/cmd/prometheus/main.go:362 +0x5229

描述pod输出：

Name:         prometheus-589c44dbfc-xkwmj
Namespace:    istio-system
Priority:     0
Node:         inspiron-7577/192.168.0.9
Start Time:   Fri, 15 May 2020 14:21:14 +0530
Labels:       app=prometheus
              pod-template-hash=589c44dbfc
              release=istio
Annotations:  sidecar.istio.io/inject: false
Status:       Running
IP:           172.17.0.11
IPs:
  IP:           172.17.0.11
Controlled By:  ReplicaSet/prometheus-589c44dbfc
Containers:
  prometheus:
    Container ID:  docker://b6820a000ab67a5ce31d3a38f6f0d510bd150794b2792147fc17ef8f730c03bb
    Image:         docker.io/prom/prometheus:v2.15.1
    Image ID:      docker-pullable://prom/prometheus@sha256:169b743ceb4452266915272f9c3409d36972e41cb52f3f28644e6c0609fc54e6
    Port:          9090/TCP
    Host Port:     0/TCP
    Args:
      --storage.tsdb.retention=6h
      --config.file=/etc/prometheus/prometheus.yml
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    2
      Started:      Fri, 15 May 2020 14:37:50 +0530
      Finished:     Fri, 15 May 2020 14:37:53 +0530
    Ready:          False
    Restart Count:  8
    Requests:
      cpu:        10m
    Liveness:     http-get http://:9090/-/healthy delay=0s timeout=1s period=10s #success=1 #failure=3
    Readiness:    http-get http://:9090/-/ready delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment:  <none>
    Mounts:
      /etc/istio-certs from istio-certs (rw)
      /etc/prometheus from config-volume (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from prometheus-token-cgqbc (ro)
  istio-proxy:
    Container ID:  docker://fa756c93510b6f402d7d88c31a5f5f066d4c254590eab70886e7835e7d3871be
    Image:         docker.io/istio/proxyv2:1.5.4
    Image ID:      docker-pullable://istio/proxyv2@sha256:e16e2801b7fd93154e8fcb5f4e2fb1240d73349d425b8be90691d48e8b9bb944
    Port:          15090/TCP
    Host Port:     0/TCP
    Args:
      proxy
      sidecar
      --domain
      $(POD_NAMESPACE).svc.cluster.local
      --configPath
      /etc/istio/proxy
      --binaryPath
      /usr/local/bin/envoy
      --serviceCluster
      istio-proxy-prometheus
      --drainDuration
      45s
      --parentShutdownDuration
      1m0s
      --discoveryAddress
      istio-pilot.istio-system.svc:15012
      --proxyLogLevel=warning
      --proxyComponentLogLevel=misc:error
      --connectTimeout
      10s
      --proxyAdminPort
      15000
      --controlPlaneAuthPolicy
      NONE
      --dnsRefreshRate
      300s
      --statusPort
      15020
      --trust-domain=cluster.local
      --controlPlaneBootstrap=false
    State:          Running
      Started:      Fri, 15 May 2020 14:21:31 +0530
    Ready:          True
    Restart Count:  0
    Readiness:      http-get http://:15020/healthz/ready delay=1s timeout=1s period=2s #success=1 #failure=30
    Environment:
      OUTPUT_CERTS:                 /etc/istio-certs
      JWT_POLICY:                   first-party-jwt
      PILOT_CERT_PROVIDER:          istiod
      CA_ADDR:                      istio-pilot.istio-system.svc:15012
      POD_NAME:                     prometheus-589c44dbfc-xkwmj (v1:metadata.name)
      POD_NAMESPACE:                istio-system (v1:metadata.namespace)
      INSTANCE_IP:                   (v1:status.podIP)
      SERVICE_ACCOUNT:               (v1:spec.serviceAccountName)
      HOST_IP:                       (v1:status.hostIP)
      ISTIO_META_POD_NAME:          prometheus-589c44dbfc-xkwmj (v1:metadata.name)
      ISTIO_META_CONFIG_NAMESPACE:  istio-system (v1:metadata.namespace)
      ISTIO_META_MESH_ID:           cluster.local
      ISTIO_META_CLUSTER_ID:        Kubernetes
    Mounts:
      /etc/istio-certs/ from istio-certs (rw)
      /etc/istio/proxy from istio-envoy (rw)
      /var/run/secrets/istio from istiod-ca-cert (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from prometheus-token-cgqbc (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  config-volume:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      prometheus
    Optional:  false
  istio-certs:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:     Memory
    SizeLimit:  <unset>
  istio-envoy:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:     Memory
    SizeLimit:  <unset>
  istiod-ca-cert:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      istio-ca-root-cert
    Optional:  false
  prometheus-token-cgqbc:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  prometheus-token-cgqbc
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type     Reason       Age                   From                    Message
  ----     ------       ----                  ----                    -------
  Normal   Scheduled    <unknown>             default-scheduler       Successfully assigned istio-system/prometheus-589c44dbfc-xkwmj to inspiron-7577
  Warning  FailedMount  17m                   kubelet, inspiron-7577  MountVolume.SetUp failed for volume "prometheus-token-cgqbc" : failed to sync secret cache: timed out waiting for the condition
  Warning  FailedMount  17m                   kubelet, inspiron-7577  MountVolume.SetUp failed for volume "config-volume" : failed to sync configmap cache: timed out waiting for the condition
  Normal   Pulled       17m                   kubelet, inspiron-7577  Container image "docker.io/istio/proxyv2:1.5.4" already present on machine
  Normal   Created      17m                   kubelet, inspiron-7577  Created container istio-proxy
  Normal   Started      17m                   kubelet, inspiron-7577  Started container istio-proxy
  Warning  Unhealthy    17m                   kubelet, inspiron-7577  Readiness probe failed: HTTP probe failed with statuscode: 503
  Normal   Pulled       16m (x4 over 17m)     kubelet, inspiron-7577  Container image "docker.io/prom/prometheus:v2.15.1" already present on machine
  Normal   Created      16m (x4 over 17m)     kubelet, inspiron-7577  Created container prometheus
  Normal   Started      16m (x4 over 17m)     kubelet, inspiron-7577  Started container prometheus
  Warning  BackOff      2m24s (x72 over 17m)  kubelet, inspiron-7577  Back-off restarting failed container

名称：普罗米修斯-589c44dbfc-xkwmj
名称空间：istio系统
优先级：0
节点：inspiron-7577/192.168.0.9
开始时间：2020年5月15日星期五14:21:14+0530
标签：app=prometheus
pod模板哈希=589c44dbfc
释放
注释：sidecar.istio.io/inject:false
状态：正在运行
IP:172.17.0.11
IPs：
IP:172.17.0.11
控制人：ReplicaSet/prometheus-589c44dbfc
容器：
普罗米修斯：
容器ID:docker://b6820a000ab67a5ce31d3a38f6f0d510bd150794b2792147fc17ef8f730c03bb
图片：docker.io/prom/prometheus:v2.15.1
图像ID:docker-pullable://prom/prometheus@sha256:169B743CEB445226915272F9C3409D36972E41CB52F3F28644E6C0609FC54E6
端口：9090/TCP
主机端口：0/TCP
Args：
--存储.tsdb.retention=6h
--config.file=/etc/prometheus/prometheus.yml
国家：等待
原因：仓促退却
最后状态：终止
原因：错误
出境代码：2
开始时间：2020年5月15日星期五14:37:50+0530
完成日期：2020年5月15日星期五14:37:53+0530
就绪：错误
重新启动计数：8
请求：
中央处理器：10米
活跃度：http get http://:9090/-/health delay=0s timeout=1s period=10s#成功=1#失败=3
准备就绪：http get http://:9090/-/ready delay=0s超时=1s周期=10s成功=1失败=3
环境：
挂载：
/来自istio证书（rw）的etc/istio证书
/来自配置卷（rw）的etc/prometheus
/来自普罗米修斯代币cgqbc（ro）的var/run/secrets/kubernetes.io/serviceCount
istio代理：
容器ID:docker://fa756c93510b6f402d7d88c31a5f5f066d4c254590eab70886e7835e7d3871be
图片：docker.io/istio/proxyv2:1.5.4
图像ID:docker-pullable://istio/proxyv2@sha256:e16e2801b7fd93154e8fcb5f4e2fb1240d73349d425b8be90691d48e8b9bb944
端口：15090/TCP
主机端口：0/TCP
Args：
代理
侧车
--领域
$（POD_名称空间）.svc.cluster.local
--配置路径
/etc/istio/proxy
--二进制路径
/usr/本地/bin/特使
--服务集群
普罗米修斯酒店
--排水硬化
45秒
--家长关闭持续时间
100毫秒
--发现地址
istio飞行员。istio系统。svc:15012
--proxyLogLevel=警告
--proxyComponentLogLevel=misc:错误
--连接超时
10秒
--proxyAdminPort
15000
--控制策略
没有一个
--DNS刷新率
300秒
--状态端口
15020
--信任域=cluster.local
--controlPlaneBootstrap=false
状态：正在运行
开始时间：2020年5月15日星期五14:21:31+0530
准备好了吗
重新启动计数：0
准备就绪：http get http://:15020/healthz/ready delay=1s timeout=1s period=2s#成功=1#失败=30
环境：
输出证书：/etc/istio证书
JWT_政策：第一方JWT
飞行员证书提供者：istiod
地址：istio pilot.istio系统svc:15012
POD_名称：prometheus-589c44dbfc-xkwmj（v1:metadata.NAME）
POD_名称空间：istio系统（v1:metadata.NAMESPACE）
实例IP：（v1:status.podIP）
服务帐户：（v1:spec.serviceAccountName）
主机IP：（v1:status.hostIP）
ISTIO_META_POD_名称：prometheus-589c44dbfc-xkwmj（v1:metadata.NAME）
ISTIO_META_CONFIG_名称空间：ISTIO系统（v1:metadata.NAMESPACE）
ISTIO_META_MESH_ID:cluster.local
ISTIO_META_CLUSTER_ID:Kubernetes
挂载：
/etc/istio证书/来自istio证书（rw）
/etc/istio/来自istio特使（rw）的代理
/来自istiod ca证书（rw）的var/run/secrets/istio
/来自普罗米修斯代币cgqbc（ro）的var/run/secrets/kubernetes.io/serviceCount
条件：
类型状态
初始化为True
准备错误
集装箱准备好了吗
播客预定为真
卷数：
配置卷：
类型：ConfigMap（由ConfigMap填充的卷）
姓名：普罗米修斯
可选：false
istio证书：
类型：EmptyDir（共享pod生存期的临时目录）
介质：内存
SizeLimit：
istio特使：
类型：EmptyDir（共享pod生存期的临时目录）
介质：内存
SizeLimit：
istiod ca证书：
类型：ConfigMap（由ConfigMap填充的卷）
名称：istio ca根证书
可选：false
普罗米修斯代币cgqbc：
类型：Secret（由Secret填充的卷）
秘名：普罗米修斯令牌cgqbc
可选：false
QoS等级：Burstable
节点选择器：
容差：node.kubernetes.io/未就绪：不执行300秒
node.kubernetes.io/不可访问：不执行300秒
活动：
从消息中键入原因年龄
----     ------       ----                  ----                    -------
正常计划的默认计划程序已成功将istio系统/prometheus-589c44dbfc-xkwmj分配给inspiron-7577
警告失败装载17m kubelet，inspiron-7577装载卷。卷“prometheus token cgqbc”的安装失败：无法同步机密缓存：等待条件时超时
警告FailedMount 17m kubelet，inspiron-7577 MountVolume。卷“配置卷”的安装失败：未能同步configmap缓存：等待时超时
kubectl create ns istio-system
kubectl apply -f - <<EOF
apiVersion: install.istio.io/v1alpha1
kind: IstioOperator
metadata:
  namespace: istio-system
  name: example-istiocontrolplane
spec:
  profile: demo
EOF