Kubernetes calico节点无法在工作节点上启动

Kubernetes calico节点无法在工作节点上启动,kubernetes,coreos,project-calico,Kubernetes,Coreos,Project Calico,我正在安装Kubernetes 配置详细信息: 控制器 CoreosAlpha开发的Linux容器(1339.0.0) 局域网IP:192.168.1.2 FQDN:coreos-2.tux-in.com 用于安装的环境变量: export MASTER_FQDN=coreos-2.tux-in.com export MASTER_IP=192.168.1.2 export WORKER_IP=192.168.1.3 export WORKER_FQDN=coreos-3.tux-in.com

我正在安装Kubernetes

配置详细信息:

控制器
  • CoreosAlpha开发的Linux容器(1339.0.0)
  • 局域网IP:192.168.1.2
  • FQDN:coreos-2.tux-in.com

  • 用于安装的环境变量:

    export MASTER_FQDN=coreos-2.tux-in.com
    export MASTER_IP=192.168.1.2
    export WORKER_IP=192.168.1.3
    export WORKER_FQDN=coreos-3.tux-in.com
    export ETCD_ENDPOINTS=http://127.0.0.1:4001
    export ADVERTISE_IP=192.168.1.2
    export K8S_VER=v1.5.4_coreos.0
    export HYPERKUBE_IMAGE_REPO=quay.io/coreos/hyperkube
    export POD_NETWORK=10.2.0.0/16
    export SERVICE_IP_RANGE=10.3.0.0/24
    export K8S_SERVICE_IP=10.3.0.1
    export DNS_SERVICE_IP=10.3.0.10
    export USE_CALICO=true
    export CONTAINER_RUNTIME=rkt
    export EMAIL="kfirufk@gmail.com"
    export uuid_file="/var/run/kubelet-pod.uuid"
    
工人
  • CoreosAlpha开发的Linux容器(1339.0.0)
  • 局域网IP:192.168.1.3
  • FQDN:coreos-3.tux-in.com

  • 用于安装的环境变量

    export ETCD_ENDPOINTS=http://127.0.0.1:4001
    export CONTROLLER_ENDPOINT=https://coreos-2.tux-in.com
    export ADVERTISE_IP=192.168.1.3
    export K8S_VER=v1.5.4_coreos.0
    export HYPERKUBE_IMAGE_REPO=quay.io/coreos/hyperkube
    export POD_NETWORK=10.2.0.0/16
    export DNS_SERVICE_IP=10.3.0.10
    export USE_CALICO=true
    export CONTAINER_RUNTIME=rkt
    export EMAIL="kfirufk@gmail.com"
    export uuid_file="/var/run/kubelet-pod.uuid"
    export  CALICO_OPTS="--volume cni-bin,kind=host,source=/opt/cni/bin \
                --mount volume=cni-bin,target=/opt/cni/bin"
    
我用我的
coreos-kubernetes
安装了控制器和工人()

kubectl获取节点
返回

NAME          STATUS    AGE
192.168.1.2   Ready     4h
192.168.1.3   Ready     4h
kubectl get pods--所有名称空间
返回:

NAMESPACE       NAME                                       READY     STATUS      RESTARTS   AGE
ceph            ceph-mds-2743106415-rkww4                  0/1       Pending     0          4h
ceph            ceph-mon-check-3856521781-bd6k5            1/1       Running     0          4h
kube-lego       kube-lego-3323932148-g2tf4                 1/1       Running     0          4h
kube-system     calico-node-xq6j7                          2/2       Running     0          4h
kube-system     calico-node-xzpp2                          0/2       Completed   488        4h
kube-system     calico-policy-controller-610849172-b7xjr   1/1       Running     0          4h
kube-system     heapster-v1.3.0-beta.0-2754576759-v1f50    2/2       Running     0          3h
kube-system     kube-apiserver-192.168.1.2                 1/1       Running     0          4h
kube-system     kube-controller-manager-192.168.1.2        1/1       Running     1          4h
kube-system     kube-dns-3675956729-r7hhf                  3/4       Running     784        4h
kube-system     kube-dns-autoscaler-505723555-l2pph        1/1       Running     973        4h
kube-system     kube-proxy-192.168.1.2                     1/1       Running     0          4h
kube-system     kube-proxy-192.168.1.3                     1/1       Running     0          4h
kube-system     kube-scheduler-192.168.1.2                 1/1       Running     1          4h
kube-system     kubernetes-dashboard-3697905830-vdz23      1/1       Running     262        4h
kube-system     monitoring-grafana-4013973156-m2r2v        1/1       Running     0          4h
kube-system     monitoring-influxdb-651061958-2mdtf        1/1       Running     0          4h
nginx-ingress   default-http-backend-150165654-s4z04       1/1       Running     2          4h
Name:           calico-node-xzpp2
Namespace:      kube-system
Node:           192.168.1.3/192.168.1.3
Start Time:     Sat, 11 Mar 2017 20:02:02 +0200
Labels:         k8s-app=calico-node
Status:         Running
IP:             192.168.1.3
Controllers:    DaemonSet/calico-node
Containers:
  calico-node:
    Container ID:       rkt://d826868f-e7f5-47af-8d5e-e5779cbc4a19:calico-node
    Image:              quay.io/calico/node:v1.1.0-rc8
    Image ID:           rkt://sha512-a03825f68ef98ab015a46de463e446c70c3ed5ccc1187a09f0cbe5d5bb594953
    Port:
    Command:
      /bin/sh
      -c
    Args:
      mount -o remount,rw /proc/sys && start_runit
    State:              Terminated
      Reason:           Completed
      Exit Code:        0
      Started:          Sun, 12 Mar 2017 00:07:01 +0200
      Finished:         Sun, 12 Mar 2017 00:07:01 +0200
    Last State:         Terminated
      Reason:           Completed
      Exit Code:        0
      Started:          Sun, 12 Mar 2017 00:06:59 +0200
      Finished:         Sun, 12 Mar 2017 00:06:59 +0200
    Ready:              False
    Restart Count:      326
    Volume Mounts:
      /calico-secrets from etcd-certs (rw)
      /lib/modules from lib-modules (rw)
      /var/run/calico from var-run-calico (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-zqbdp (ro)
    Environment Variables:
      ETCD_ENDPOINTS:                   <set to the key 'etcd_endpoints' of config map 'calico-config'>
      CALICO_NETWORKING_BACKEND:        <set to the key 'calico_backend' of config map 'calico-config'>
      CALICO_DISABLE_FILE_LOGGING:      true
      NO_DEFAULT_POOLS:                 true
      FELIX_LOGSEVERITYSCREEN:          info
      ETCD_CA_CERT_FILE:                <set to the key 'etcd_ca' of config map 'calico-config'>
      ETCD_KEY_FILE:                    <set to the key 'etcd_key' of config map 'calico-config'>
      ETCD_CERT_FILE:                   <set to the key 'etcd_cert' of config map 'calico-config'>
      IP:
  install-cni:
    Container ID:       rkt://d826868f-e7f5-47af-8d5e-e5779cbc4a19:install-cni
    Image:              quay.io/calico/cni:v1.6.0-4-g76b234c
    Image ID:           rkt://sha512-9a04ebb8ecc83b261e937a2ad1a5abefd09b1573f7c5fb05aafcfda59cc7806b
    Port:
    Command:
      /bin/sh
      -c
    Args:
      export CNI_NETWORK_CONFIG=$(cat /host/cni_network_config/config.conf) && /install-cni.sh
    State:              Terminated
      Reason:           Completed
      Exit Code:        0
      Started:          Sun, 12 Mar 2017 00:07:01 +0200
      Finished:         Sun, 12 Mar 2017 00:07:01 +0200
    Last State:         Terminated
      Reason:           Completed
      Exit Code:        0
      Started:          Sun, 12 Mar 2017 00:06:59 +0200
      Finished:         Sun, 12 Mar 2017 00:06:59 +0200
    Ready:              False
    Restart Count:      326
    Volume Mounts:
      /calico-secrets from etcd-certs (rw)
      /host/cni_network_config from cni-config (rw)
      /host/etc/cni/net.d from cni-net-dir (rw)
      /host/opt/cni/bin from cni-bin-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-zqbdp (ro)
    Environment Variables:
      ETCD_ENDPOINTS:   <set to the key 'etcd_endpoints' of config map 'calico-config'>
      CNI_CONF_NAME:    10-calico.conf
Conditions:
  Type          Status
  Initialized   True
  Ready         False
  PodScheduled  True
Volumes:
  lib-modules:
    Type:       HostPath (bare host directory volume)
    Path:       /lib/modules
  var-run-calico:
    Type:       HostPath (bare host directory volume)
    Path:       /var/run/calico
  cni-bin-dir:
    Type:       HostPath (bare host directory volume)
    Path:       /opt/cni/bin
  cni-net-dir:
    Type:       HostPath (bare host directory volume)
    Path:       /etc/kubernetes/cni/net.d
  etcd-certs:
    Type:       Secret (a volume populated by a Secret)
    SecretName: calico-etcd-secrets
  cni-config:
    Type:       ConfigMap (a volume populated by a ConfigMap)
    Name:       calico-config
  default-token-zqbdp:
    Type:       Secret (a volume populated by a Secret)
    SecretName: default-token-zqbdp
QoS Class:      BestEffort
Tolerations:    CriticalAddonsOnly=:Exists
                dedicated=master:NoSchedule
Events:
  FirstSeen     LastSeen        Count   From                    SubObjectPath                   Type            Reason  Message
  ---------     --------        -----   ----                    -------------                   --------        ------  -------
  13s   13s     1       {kubelet 192.168.1.3}   spec.containers{install-cni}    Normal  Created         Created with rkt id afedb13c
  13s   13s     1       {kubelet 192.168.1.3}   spec.containers{calico-node}    Normal  Started         Started with rkt id afedb13c
我注意到有两项服务没有完全发挥作用

kube-dns-3675956729-r7hhf
-4个服务中有3个已准备就绪
calico-node-xzpp2
-工作节点(coreos-3.tux-in.com)上的calico节点继续重新启动

kubectl description-pod-calico-node-xzpp2--namespace=kube-system
返回:

NAMESPACE       NAME                                       READY     STATUS      RESTARTS   AGE
ceph            ceph-mds-2743106415-rkww4                  0/1       Pending     0          4h
ceph            ceph-mon-check-3856521781-bd6k5            1/1       Running     0          4h
kube-lego       kube-lego-3323932148-g2tf4                 1/1       Running     0          4h
kube-system     calico-node-xq6j7                          2/2       Running     0          4h
kube-system     calico-node-xzpp2                          0/2       Completed   488        4h
kube-system     calico-policy-controller-610849172-b7xjr   1/1       Running     0          4h
kube-system     heapster-v1.3.0-beta.0-2754576759-v1f50    2/2       Running     0          3h
kube-system     kube-apiserver-192.168.1.2                 1/1       Running     0          4h
kube-system     kube-controller-manager-192.168.1.2        1/1       Running     1          4h
kube-system     kube-dns-3675956729-r7hhf                  3/4       Running     784        4h
kube-system     kube-dns-autoscaler-505723555-l2pph        1/1       Running     973        4h
kube-system     kube-proxy-192.168.1.2                     1/1       Running     0          4h
kube-system     kube-proxy-192.168.1.3                     1/1       Running     0          4h
kube-system     kube-scheduler-192.168.1.2                 1/1       Running     1          4h
kube-system     kubernetes-dashboard-3697905830-vdz23      1/1       Running     262        4h
kube-system     monitoring-grafana-4013973156-m2r2v        1/1       Running     0          4h
kube-system     monitoring-influxdb-651061958-2mdtf        1/1       Running     0          4h
nginx-ingress   default-http-backend-150165654-s4z04       1/1       Running     2          4h
Name:           calico-node-xzpp2
Namespace:      kube-system
Node:           192.168.1.3/192.168.1.3
Start Time:     Sat, 11 Mar 2017 20:02:02 +0200
Labels:         k8s-app=calico-node
Status:         Running
IP:             192.168.1.3
Controllers:    DaemonSet/calico-node
Containers:
  calico-node:
    Container ID:       rkt://d826868f-e7f5-47af-8d5e-e5779cbc4a19:calico-node
    Image:              quay.io/calico/node:v1.1.0-rc8
    Image ID:           rkt://sha512-a03825f68ef98ab015a46de463e446c70c3ed5ccc1187a09f0cbe5d5bb594953
    Port:
    Command:
      /bin/sh
      -c
    Args:
      mount -o remount,rw /proc/sys && start_runit
    State:              Terminated
      Reason:           Completed
      Exit Code:        0
      Started:          Sun, 12 Mar 2017 00:07:01 +0200
      Finished:         Sun, 12 Mar 2017 00:07:01 +0200
    Last State:         Terminated
      Reason:           Completed
      Exit Code:        0
      Started:          Sun, 12 Mar 2017 00:06:59 +0200
      Finished:         Sun, 12 Mar 2017 00:06:59 +0200
    Ready:              False
    Restart Count:      326
    Volume Mounts:
      /calico-secrets from etcd-certs (rw)
      /lib/modules from lib-modules (rw)
      /var/run/calico from var-run-calico (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-zqbdp (ro)
    Environment Variables:
      ETCD_ENDPOINTS:                   <set to the key 'etcd_endpoints' of config map 'calico-config'>
      CALICO_NETWORKING_BACKEND:        <set to the key 'calico_backend' of config map 'calico-config'>
      CALICO_DISABLE_FILE_LOGGING:      true
      NO_DEFAULT_POOLS:                 true
      FELIX_LOGSEVERITYSCREEN:          info
      ETCD_CA_CERT_FILE:                <set to the key 'etcd_ca' of config map 'calico-config'>
      ETCD_KEY_FILE:                    <set to the key 'etcd_key' of config map 'calico-config'>
      ETCD_CERT_FILE:                   <set to the key 'etcd_cert' of config map 'calico-config'>
      IP:
  install-cni:
    Container ID:       rkt://d826868f-e7f5-47af-8d5e-e5779cbc4a19:install-cni
    Image:              quay.io/calico/cni:v1.6.0-4-g76b234c
    Image ID:           rkt://sha512-9a04ebb8ecc83b261e937a2ad1a5abefd09b1573f7c5fb05aafcfda59cc7806b
    Port:
    Command:
      /bin/sh
      -c
    Args:
      export CNI_NETWORK_CONFIG=$(cat /host/cni_network_config/config.conf) && /install-cni.sh
    State:              Terminated
      Reason:           Completed
      Exit Code:        0
      Started:          Sun, 12 Mar 2017 00:07:01 +0200
      Finished:         Sun, 12 Mar 2017 00:07:01 +0200
    Last State:         Terminated
      Reason:           Completed
      Exit Code:        0
      Started:          Sun, 12 Mar 2017 00:06:59 +0200
      Finished:         Sun, 12 Mar 2017 00:06:59 +0200
    Ready:              False
    Restart Count:      326
    Volume Mounts:
      /calico-secrets from etcd-certs (rw)
      /host/cni_network_config from cni-config (rw)
      /host/etc/cni/net.d from cni-net-dir (rw)
      /host/opt/cni/bin from cni-bin-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-zqbdp (ro)
    Environment Variables:
      ETCD_ENDPOINTS:   <set to the key 'etcd_endpoints' of config map 'calico-config'>
      CNI_CONF_NAME:    10-calico.conf
Conditions:
  Type          Status
  Initialized   True
  Ready         False
  PodScheduled  True
Volumes:
  lib-modules:
    Type:       HostPath (bare host directory volume)
    Path:       /lib/modules
  var-run-calico:
    Type:       HostPath (bare host directory volume)
    Path:       /var/run/calico
  cni-bin-dir:
    Type:       HostPath (bare host directory volume)
    Path:       /opt/cni/bin
  cni-net-dir:
    Type:       HostPath (bare host directory volume)
    Path:       /etc/kubernetes/cni/net.d
  etcd-certs:
    Type:       Secret (a volume populated by a Secret)
    SecretName: calico-etcd-secrets
  cni-config:
    Type:       ConfigMap (a volume populated by a ConfigMap)
    Name:       calico-config
  default-token-zqbdp:
    Type:       Secret (a volume populated by a Secret)
    SecretName: default-token-zqbdp
QoS Class:      BestEffort
Tolerations:    CriticalAddonsOnly=:Exists
                dedicated=master:NoSchedule
Events:
  FirstSeen     LastSeen        Count   From                    SubObjectPath                   Type            Reason  Message
  ---------     --------        -----   ----                    -------------                   --------        ------  -------
  13s   13s     1       {kubelet 192.168.1.3}   spec.containers{install-cni}    Normal  Created         Created with rkt id afedb13c
  13s   13s     1       {kubelet 192.168.1.3}   spec.containers{calico-node}    Normal  Started         Started with rkt id afedb13c
名称:印花布-node-xzpp2
名称空间:kube系统
节点:192.168.1.3/192.168.1.3
开始时间:2017年3月11日星期六20:02:02+0200
标签:k8s app=印花布节点
状态:正在运行
IP:192.168.1.3
控制器:守护程序/calico节点
容器:
印花布节点:
容器ID:rkt://d826868f-e7f5-47af-8d5e-e5779cbc4a19:calico-节点
图片:quay.io/calico/node:v1.1.0-rc8
图像ID:rkt://sha512-a03825f68ef98ab015a46de463e446c70c3ed5ccc1187a09f0cbe5d5bb594953
端口:
命令:
/垃圾箱/垃圾箱
-c
Args:
挂载-o重新挂载,rw/proc/sys&&start\u运行它
国家:终止
原因:已完成
退出代码:0
开始日期:2017年3月12日星期日00:07:01+0200
完成日期:2017年3月12日星期日00:07:01+0200
最后状态:终止
原因:已完成
退出代码:0
开始日期:2017年3月12日星期日00:06:59+0200
完成日期:2017年3月12日星期日00:06:59+0200
就绪:错误
重新启动计数:326
卷装载:
/来自etcd证书的印花布秘密(rw)
/库/来自库模块的模块(rw)
/var/run/calico来自var run calico(rw)
/来自默认令牌zqbdp(ro)的var/run/secrets/kubernetes.io/serviceCount
环境变量:
ETCD_端点:
印花布网络后端:
印花布禁用文件日志记录:true
无\u默认\u池:true
FELIX_LogSeverity屏幕:信息
ETCD证书文件:
ETCD密钥文件:
ETCD证书文件:
知识产权:
安装cni:
容器ID:rkt://d826868f-e7f5-47af-8d5e-e5779cbc4a19:install-cni
图片:quay.io/calico/cni:v1.6.0-4-g76b234c
图像ID:rkt://sha512-9a04ebb8ecc83b261e937a2ad1a5abefd09b1573f7c5fb05aafcfda59cc7806b
端口:
命令:
/垃圾箱/垃圾箱
-c
Args:
导出CNI_NETWORK_CONFIG=$(cat/host/CNI_NETWORK_CONFIG/CONFIG.conf)和&/install-CNI.sh
国家:终止
原因:已完成
退出代码:0
开始日期:2017年3月12日星期日00:07:01+0200
完成日期:2017年3月12日星期日00:07:01+0200
最后状态:终止
原因:已完成
退出代码:0
开始日期:2017年3月12日星期日00:06:59+0200
完成日期:2017年3月12日星期日00:06:59+0200
就绪:错误
重新启动计数:326
卷装载:
/来自etcd证书的印花布秘密(rw)
/主机/cni_网络_配置来自cni配置(rw)
/主机/etc/cni/net.d来自cni网络目录(rw)
/主机/opt/cni/bin来自cni-bin-dir(rw)
/来自默认令牌zqbdp(ro)的var/run/secrets/kubernetes.io/serviceCount
环境变量:
ETCD_端点:
CNI_CONF_名称:10-calico.CONF
条件:
类型状态
初始化为True
准备错误
播客预定为真
卷数:
lib模块:
类型:主机路径(裸主机目录卷)
路径:/lib/模块
var run印花布:
类型:主机路径(裸主机目录卷)
路径:/var/run/calico
cni bin dir:
类型:主机路径(裸主机目录卷)
路径:/opt/cni/bin
网络总监:
类型:主机路径(裸主机目录卷)
路径:/etc/kubernetes/cni/net.d
etcd证书:
类型:Secret(由Secret填充的卷)
机密名称:印花布etcd机密
cni配置:
类型:ConfigMap(由ConfigMap填充的卷)
名称:印花布配置
默认令牌zqbdp:
类型:Secret(由Secret填充的卷)
SecretName:默认令牌zqbdp
QoS等级:最佳努力
容忍度:CriticalAddressOnly=:存在
专用=主:无时间表
活动:
子对象路径类型原因消息中的FirstSeen LastSeen计数
---------     --------        -----   ----                    -------------                   --------        ------  -------
13s 13s 1{kubelet 192.168.1.3}spec.containers{install cni}使用rkt id afedb13c创建的正常
13s 13s 1{kubelet 192.168.1.3}spec.containers{calico node}正常启动,使用rkt id afedb13c启动
对于install cni
calico node`,
Created
Started eents有更多的消息

kubectl logs calico-node-xzpp2--namespace=kube system-c install cni或calico node
返回空输出

我如何进一步调查这个问题


谢谢

我要检查calico节点无法启动的主机上的
journalctl-xe
。既然你什么都没得到