Python 纤毛荚等待使用kuberspay

Python 纤毛荚等待使用kuberspay,python,kubernetes,Python,Kubernetes,环境: Openstack与Ubuntu虚拟机 Kuberspay使用Cilium作为网络插件安装kubernetes 安装后: root@admin01:/home/ubuntu#kubectl getpods-o-wide——所有名称空间 NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED N

环境:

Openstack与Ubuntu虚拟机

Kuberspay使用Cilium作为网络插件安装kubernetes

安装后:

root@admin01:/home/ubuntu#kubectl getpods-o-wide——所有名称空间

NAMESPACE     NAME                                    READY   STATUS    RESTARTS   AGE    IP               NODE      NOMINATED NODE   READINESS GATES
kube-system   cilium-4c4jb                            1/1     Running   0          5d4h   10.224.222.92    work003   <none>           <none>
kube-system   cilium-78tmj                            1/1     Running   0          5d4h   10.224.222.90    admin02   <none>           <none>
kube-system   cilium-8sgck                            1/1     Running   0          5d4h   10.224.222.52    admin03   <none>           <none>
kube-system   cilium-k2pck                            1/1     Running   0          5d4h   10.224.222.107   work001   <none>           <none>
kube-system   cilium-kzjxk                            1/1     Running   0          5d4h   10.224.222.64    admin01   <none>           <none>
kube-system   cilium-nfpf5                            1/1     Running   0          5d4h   10.224.222.79    work002   <none>           <none>
kube-system   cilium-operator-5d74fc4fd6-jqpjc        0/1     Pending   0          16h    <none>           <none>    <none>           <none>
kube-system   coredns-58687784f9-5j67p                0/1     Pending   0          16h    <none>           <none>    <none>           <none>
kube-system   dns-autoscaler-79599df498-pxr6x         0/1     Pending   0          16h    <none>           <none>    <none>           <none>
与其他网络插件(如calico)相比,/etc/cni/net.d/只包含一个文件:05-cilium.conf:

root@admin01:/etc/cni/net.d# cat 05-cilium.conf
{
    "name": "cilium",
    "type": "cilium-cni"
}
有关节点的其他信息:

root@admin01:/home/ubuntu# kubectl describe node
Name:               admin01
Roles:              master
Labels:             beta.kubernetes.io/arch=amd64
                    beta.kubernetes.io/os=linux
                    kubernetes.io/arch=amd64
                    kubernetes.io/hostname=admin01
                    kubernetes.io/os=linux
                    node-role.kubernetes.io/master=
Annotations:        io.cilium.network.ipv4-cilium-host: 10.233.64.1
                    io.cilium.network.ipv4-health-ip: 10.233.64.140
                    io.cilium.network.ipv4-pod-cidr: 10.233.64.0/24
                    kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
                    node.alpha.kubernetes.io/ttl: 0
                    volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp:  Thu, 05 Dec 2019 22:10:05 +0000
Taints:             node-role.kubernetes.io/master:NoSchedule
                    node.kubernetes.io/not-ready:NoSchedule
Unschedulable:      false
Conditions:
  Type                 Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
  ----                 ------  -----------------                 ------------------                ------                       -------
  NetworkUnavailable   False   Thu, 05 Dec 2019 22:12:23 +0000   Thu, 05 Dec 2019 22:12:23 +0000   CiliumIsUp                   Cilium is running on this node
  MemoryPressure       False   Thu, 12 Dec 2019 02:12:56 +0000   Thu, 05 Dec 2019 22:09:59 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
  DiskPressure         False   Thu, 12 Dec 2019 02:12:56 +0000   Thu, 05 Dec 2019 22:09:59 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
  PIDPressure          False   Thu, 12 Dec 2019 02:12:56 +0000   Thu, 05 Dec 2019 22:09:59 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
  Ready                False   Thu, 12 Dec 2019 02:12:56 +0000   Thu, 05 Dec 2019 22:09:59 +0000   KubeletNotReady              runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
Addresses:
  InternalIP:  10.224.222.64
  Hostname:    admin01
Capacity:
 cpu:                2
 ephemeral-storage:  81120644Ki
 hugepages-1Gi:      0
 hugepages-2Mi:      0
 memory:             4039464Ki
 pods:               110
Allocatable:
 cpu:                1800m
 ephemeral-storage:  74760785387
 hugepages-1Gi:      0
 hugepages-2Mi:      0
 memory:             3437064Ki
 pods:               110
System Info:
 Machine ID:                 051d190f0ef34b08ac10f08827a564ed
 System UUID:                051D190F-0EF3-4B08-AC10-F08827A564ED
 Boot ID:                    48689d4e-bba2-4f69-85fd-4ec4b12981c5
 Kernel Version:             4.15.0-42-generic
 OS Image:                   Ubuntu 18.04.1 LTS
 Operating System:           linux
 Architecture:               amd64
 Container Runtime Version:  docker://18.9.7
 Kubelet Version:            v1.16.3
 Kube-Proxy Version:         v1.16.3
PodCIDR:                     10.233.64.0/24
PodCIDRs:                    10.233.64.0/24
Non-terminated Pods:         (6 in total)
  Namespace                  Name                               CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
  ---------                  ----                               ------------  ----------  ---------------  -------------  ---
  kube-system                cilium-kzjxk                       100m (5%)     500m (27%)  64M (1%)         500M (14%)     6d4h
  kube-system                kube-apiserver-admin01             250m (13%)    0 (0%)      0 (0%)           0 (0%)         6d4h
  kube-system                kube-controller-manager-admin01    200m (11%)    0 (0%)      0 (0%)           0 (0%)         6d4h
  kube-system                kube-proxy-r9mk6                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         44h
  kube-system                kube-scheduler-admin01             100m (5%)     0 (0%)      0 (0%)           0 (0%)         6d4h
  kube-system                nodelocaldns-6wj8x                 100m (5%)     0 (0%)      70Mi (2%)        170Mi (5%)     6d4h
Allocated resources:
  (Total limits may be over 100 percent, i.e., overcommitted.)
  Resource           Requests        Limits
  --------           --------        ------
  cpu                750m (41%)      500m (27%)
  memory             137400320 (3%)  678257920 (19%)
  ephemeral-storage  0 (0%)          0 (0%)
Events:              <none>
root@admin01:/home/ubuntu#kubectl描述节点
姓名:admin01
角色:硕士
标签:beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=admin01
kubernetes.io/os=linux
node-role.kubernetes.io/master=
注释:io.cilium.network.ipv4-cilium-host:10.233.64.1
io.cilium.network.ipv4-health-ip:10.233.64.140
io.cilium.network.ipv4-pod-cidr:10.233.64.0/24
kubeadm.alpha.kubernetes.io/cri-socket:/var/run/dockershim.sock
node.alpha.kubernetes.io/ttl:0
volumes.kubernetes.io/controller-managed-attach-detach:true
CreationTimestamp:2019年12月5日星期四22:10:05+0000
污点:节点角色.kubernetes.io/master:NoSchedule
node.kubernetes.io/not ready:NoSchedule
计划外:错误
条件:
键入状态LastHeartbeatTime LastTransitionTime原因消息
----                 ------  -----------------                 ------------------                ------                       -------
NetworkUnavailable False Thu,2019年12月5日22:12:23+0000 Thu,2019年12月5日22:12:23+0000 CiliumIsUp Cilium正在该节点上运行
MemoryPressure False Thu,2019年12月12日02:12:56+0000 Thu,2019年12月5日22:09:59+0000 Kubelethassufficient内存kubelet有足够的可用内存
DiskPressure False Thu,2019年12月12日02:12:56+0000 Thu,2019年12月5日22:09:59+0000 KubelethasNodeDiskPressure kubelet无圆盘压力
PID压力假Thu,2019年12月12日02:12:56+0000 Thu,2019年12月5日22:09:59+0000 Kubelethassufficient PID kubelet有足够的可用PID
Ready False Thu,2019年12月12日02:12:56+0000 Thu,2019年12月5日22:09:59+0000 KubeletNotReady运行时网络未就绪:NetworkReady=False原因:NetworkPluginTready消息:docker:网络插件未就绪:cni配置未初始化
地址:
内部IP:10.224.222.64
主机名:admin01
容量:
中央处理器:2
短暂存储:81120644Ki
hugepages-1Gi:0
hugepages-2Mi:0
内存:4039464Ki
豆荚:110
可分配:
cpu:1800m
短暂存储:74760785387
hugepages-1Gi:0
hugepages-2Mi:0
内存:3437064Ki
豆荚:110
系统信息:
机器ID:051d190f0ef34b08ac10f08827a564ed
系统UUID:051D190F-0EF3-4B08-AC10-F08827A564ED
启动ID:48689d4e-bba2-4f69-85fd-4ec4b12981c5
内核版本:4.15.0-42-generic
操作系统映像:Ubuntu 18.04.1 LTS
操作系统:linux
架构:amd64
容器运行时版本:docker://18.9.7
Kubelet版本:v1.16.3
Kube代理版本:v1.16.3
PodCIDR:10.233.64.0/24
苹果酒:10.233.64.0/24
非端接吊舱:(共6个)
命名空间名称CPU请求CPU限制内存请求内存限制使用年限
---------                  ----                               ------------  ----------  ---------------  -------------  ---
kube系统纤毛kzjxk 100m(5%)500m(27%)64M(1%)500m(14%)6d4h
kube系统kube-apiserver-admin01 250m(13%)0(0%)0(0%)0(0%)6d4h
kube系统kube-controller-manager-admin01 200米(11%)0(0%)0(0%)0(0%)6小时
kube系统kube-proxy-r9mk6 0(0%)0(0%)0(0%)0(0%)44h
kube系统kube-scheduler-admin01 100m(5%)0(0%)0(0%)0(0%)6d4h
kube系统nodelocaldns-6wj8x 100m(5%)0(0%)70Mi(2%)170Mi(5%)6d4h
分配的资源:
(总限额可能超过100%,即超额承诺。)
资源请求限制
--------           --------        ------
cpu 750m(41%)500m(27%)
内存137400320(3%)678257920(19%)
短期存储量0(0%)0(0%)
活动:

Cilium是否需要比其他网络插件更多的CPU资源?我是否应该为kubernetes管理员节点分配更多的CPU资源?

旧版本的cilium和最新的kubernetes群集之间存在一些错误。Kubespray已经发布了补丁,请参考此链接:

你好,quyadong,欢迎访问SO。这条信息准确地描述了问题所在——也许阅读这些信息会帮助你在豆荚中增加容忍度,或者从你的节点中去除污点是的,我明白了。但是我想知道为什么cilium存在这个问题,但是其他网络插件在使用kubespray时工作得很好。而其他POD,比如coredns和dns autoscaler,遇到了同样的问题,但是它们共享相同的kubespray设置,为什么Cilium网络插件中存在问题?你能更新你的问题并包括
kubectl descripe node | grep-i污点的输出吗
?这看起来像是kubespray本身的问题,最好在
root@admin01:/etc/cni/net.d# cat 05-cilium.conf
{
    "name": "cilium",
    "type": "cilium-cni"
}
root@admin01:/home/ubuntu# kubectl describe node
Name:               admin01
Roles:              master
Labels:             beta.kubernetes.io/arch=amd64
                    beta.kubernetes.io/os=linux
                    kubernetes.io/arch=amd64
                    kubernetes.io/hostname=admin01
                    kubernetes.io/os=linux
                    node-role.kubernetes.io/master=
Annotations:        io.cilium.network.ipv4-cilium-host: 10.233.64.1
                    io.cilium.network.ipv4-health-ip: 10.233.64.140
                    io.cilium.network.ipv4-pod-cidr: 10.233.64.0/24
                    kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
                    node.alpha.kubernetes.io/ttl: 0
                    volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp:  Thu, 05 Dec 2019 22:10:05 +0000
Taints:             node-role.kubernetes.io/master:NoSchedule
                    node.kubernetes.io/not-ready:NoSchedule
Unschedulable:      false
Conditions:
  Type                 Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
  ----                 ------  -----------------                 ------------------                ------                       -------
  NetworkUnavailable   False   Thu, 05 Dec 2019 22:12:23 +0000   Thu, 05 Dec 2019 22:12:23 +0000   CiliumIsUp                   Cilium is running on this node
  MemoryPressure       False   Thu, 12 Dec 2019 02:12:56 +0000   Thu, 05 Dec 2019 22:09:59 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
  DiskPressure         False   Thu, 12 Dec 2019 02:12:56 +0000   Thu, 05 Dec 2019 22:09:59 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
  PIDPressure          False   Thu, 12 Dec 2019 02:12:56 +0000   Thu, 05 Dec 2019 22:09:59 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
  Ready                False   Thu, 12 Dec 2019 02:12:56 +0000   Thu, 05 Dec 2019 22:09:59 +0000   KubeletNotReady              runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized
Addresses:
  InternalIP:  10.224.222.64
  Hostname:    admin01
Capacity:
 cpu:                2
 ephemeral-storage:  81120644Ki
 hugepages-1Gi:      0
 hugepages-2Mi:      0
 memory:             4039464Ki
 pods:               110
Allocatable:
 cpu:                1800m
 ephemeral-storage:  74760785387
 hugepages-1Gi:      0
 hugepages-2Mi:      0
 memory:             3437064Ki
 pods:               110
System Info:
 Machine ID:                 051d190f0ef34b08ac10f08827a564ed
 System UUID:                051D190F-0EF3-4B08-AC10-F08827A564ED
 Boot ID:                    48689d4e-bba2-4f69-85fd-4ec4b12981c5
 Kernel Version:             4.15.0-42-generic
 OS Image:                   Ubuntu 18.04.1 LTS
 Operating System:           linux
 Architecture:               amd64
 Container Runtime Version:  docker://18.9.7
 Kubelet Version:            v1.16.3
 Kube-Proxy Version:         v1.16.3
PodCIDR:                     10.233.64.0/24
PodCIDRs:                    10.233.64.0/24
Non-terminated Pods:         (6 in total)
  Namespace                  Name                               CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
  ---------                  ----                               ------------  ----------  ---------------  -------------  ---
  kube-system                cilium-kzjxk                       100m (5%)     500m (27%)  64M (1%)         500M (14%)     6d4h
  kube-system                kube-apiserver-admin01             250m (13%)    0 (0%)      0 (0%)           0 (0%)         6d4h
  kube-system                kube-controller-manager-admin01    200m (11%)    0 (0%)      0 (0%)           0 (0%)         6d4h
  kube-system                kube-proxy-r9mk6                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         44h
  kube-system                kube-scheduler-admin01             100m (5%)     0 (0%)      0 (0%)           0 (0%)         6d4h
  kube-system                nodelocaldns-6wj8x                 100m (5%)     0 (0%)      70Mi (2%)        170Mi (5%)     6d4h
Allocated resources:
  (Total limits may be over 100 percent, i.e., overcommitted.)
  Resource           Requests        Limits
  --------           --------        ------
  cpu                750m (41%)      500m (27%)
  memory             137400320 (3%)  678257920 (19%)
  ephemeral-storage  0 (0%)          0 (0%)
Events:              <none>