Kubernetes 如果删除cepfs的资源池并重建它，则会出现问题，cepfilesystem创建的池将不可用

如果删除cepfs资源池并重建它，则会出现问题，您将无法使用由cepfilesystem创建的池

使用的清单如下所示

apiVersion: ceph.rook.io/v1
kind: CephFilesystem
metadata:
  name: myfs
spec:
  metadataPool:
    replicated:
      size: 2
      requireSafeReplicaSize: true
  dataPools:
    - failureDomain: osd
      replicated:
        size: 2
        requireSafeReplicaSize: true
  preserveFilesystemOnDelete: true
  metadataServer:
    activeCount: 1
    activeStandby: true

kubectl删除-f

无法删除cephfs使用上述命令创建的池！ 因此，我使用以下命令删除了池

ceph fs rm myfs --yes-i-really-mean-it
ceph osd pool delete myfs-data0 myfs-data0 --yes-i-really-really-mean-it
ceph osd pool delete myfs-metadata myfs-metadata --yes-i-really-really-mean-it

然而，即使在重建资源之后，pvc仍然给出以下错误

Events:
  Type     Reason                Age                   From                                                                                                             Message
  ----     ------                ----                  ----                                                                                                             -------
  Warning  ProvisioningFailed    52m (x6 over 76m)     rook-ceph.cephfs.csi.ceph.com_csi-cephfsplugin-provisioner-786c55674-vh85x_a61583f5-1ee3-45b7-a530-4af167a55409  (combined from similar events): failed to provision volume with StorageClass "rook-cephfs": rpc error: code = Internal desc = an error (exit status 2) occurred while running ceph args: [fs subvolume create myfs csi-vol-871dab3a-24bb-11eb-83b8-a2a2d03a0d73 10737418240 --group_name csi --mode 777 -m 10.43.238.86:6789,10.43.3.26:6789,10.43.190.156:6789 -c /etc/ceph/ceph.conf -n client.csi-cephfs-provisioner --keyfile=***stripped*** --pool_layout myfs-data0]
  Normal   Provisioning          2m10s (x25 over 81m)  rook-ceph.cephfs.csi.ceph.com_csi-cephfsplugin-provisioner-786c55674-vh85x_a61583f5-1ee3-45b7-a530-4af167a55409  External provisioner is provisioning volume for claim "default/cephfs-pvc-csi"
  Normal   ExternalProvisioning  64s (x322 over 81m)   persistentvolume-controller                                                                                      waiting for a volume to be created, either by external provisioner "rook-ceph.cephfs.csi.ceph.com" or manually created by system administrator

---

是否有办法解决此问题并使Cepfile系统可用？

能否提供

ceph fs ls

的输出？

ceph fs rm myfs --yes-i-really-mean-it
ceph osd pool delete myfs-data0 myfs-data0 --yes-i-really-really-mean-it
ceph osd pool delete myfs-metadata myfs-metadata --yes-i-really-really-mean-it

Events:
  Type     Reason                Age                   From                                                                                                             Message
  ----     ------                ----                  ----                                                                                                             -------
  Warning  ProvisioningFailed    52m (x6 over 76m)     rook-ceph.cephfs.csi.ceph.com_csi-cephfsplugin-provisioner-786c55674-vh85x_a61583f5-1ee3-45b7-a530-4af167a55409  (combined from similar events): failed to provision volume with StorageClass "rook-cephfs": rpc error: code = Internal desc = an error (exit status 2) occurred while running ceph args: [fs subvolume create myfs csi-vol-871dab3a-24bb-11eb-83b8-a2a2d03a0d73 10737418240 --group_name csi --mode 777 -m 10.43.238.86:6789,10.43.3.26:6789,10.43.190.156:6789 -c /etc/ceph/ceph.conf -n client.csi-cephfs-provisioner --keyfile=***stripped*** --pool_layout myfs-data0]
  Normal   Provisioning          2m10s (x25 over 81m)  rook-ceph.cephfs.csi.ceph.com_csi-cephfsplugin-provisioner-786c55674-vh85x_a61583f5-1ee3-45b7-a530-4af167a55409  External provisioner is provisioning volume for claim "default/cephfs-pvc-csi"
  Normal   ExternalProvisioning  64s (x322 over 81m)   persistentvolume-controller                                                                                      waiting for a volume to be created, either by external provisioner "rook-ceph.cephfs.csi.ceph.com" or manually created by system administrator