Pods stuck in Init state due to a failed volume mount in sdnc pod.  Secret "dev-sdnc-secret-0" is not getting created. 

 

Sdnc log:

Warning  FailedMount  47m                   kubelet  Unable to attach or mount volumes: unmounted volumes=[certmanager-certs-volume-0], unattached volumes=[aaf-agent-certs aaf-add-config dev-sdnc-data logs dev-sdnc-read-token-c2ltc certmanager-certs-volume-0 certmanager-certs-volume-0-dir config-input sdnc-logging-cfg-config dev-sdnc-aaf-config localtime bin properties]: timed out waiting for the condition

Warning  FailedMount  24s (x38 over 65m)    kubelet  MountVolume.SetUp failed for volume "certmanager-certs-volume-0" : secret "dev-sdnc-secret-0" not found

 __ 

The secret "dev-sdnc-secret-0" is not created.

 

root@xerces-master-control-loop-02-nfs:~# kubectl get po | grep sdnc

dev-sdnc-0                                                                   0/1     Init:0/5           0          68m

dev-sdnc-ansible-server-79b7d67db5-vd2r7        0/1     Init:Error         0          68m

dev-sdnc-dbinit-job-xc5xz                                         0/1     Completed     0          68m

dev-sdnc-dgbuilder-7b56d5f5b5-xmswr                1/1     Running          0          68m

dev-sdnc-dmaap-listener-8455545bbd-zg5pw     0/1     Init:1/2            0          68m

dev-sdnc-sdnrdb-init-job-rld7t                                0/1     PodInitializing   0          68m

dev-sdnc-ueb-listener-b68d8d8b7-58x7r              0/1     Init:1/2             0          68m

dev-sdnc-web-8f9f45fb-rl24j                                   0/1     Init:2/3             6          68m

 

The cert manager pods are running okay.

root@xerces-master-control-loop-02-nfs:~# kubectl get po -n cert-manager

cert-manager-7c6f78c46d-2fgf7                            1/1     Running   1          7d22h

cert-manager-cainjector-668d9c86df-grqgw      1/1     Running   161        7d22h

cert-manager-webhook-979688b46-mpqf4        1/1     Running   0          7d22h