-
Bug
-
Resolution: Unresolved
-
Medium
-
None
-
None
-
None
-
OOM Sprint 5
Zoran and I worked on this
It looks like a change was made between 0904 and 0908 that causes the portal apps container to fail startup - the change was to expose the logback config so we could change the log structure/level outside the running container
The error I have seen in the past and thought it was a transient timing issue - as is usually gets fixed by a restart - in this case we needed to remove the log exposure
WEB-INF/classes/logback.xml\\\\\\\\\\\\\\\" caused \\\\\\\\\\\\\\\"not a directory
both the volume and volumemount were deleted from portal-apps-deployment.yaml
- mountPath: "{{ .Values.onapPortal.webappsDir }}/ECOMPPORTAL/WEB-INF/classes/logback.xml"
name: portal-logback
Search Line limits were exceeded, some dns names have been omitted, the applied search line is: onap-portal.svc.cluster.local svc.cluster.local cluster.local kubelet.kubernetes.rancher.internal kubernetes.rancher.internal rancher.internal
Error: failed to start container "portalapps": Error response from daemon: {"message":"invalid header field value \"oci runtime error: container_linux.go:247: starting container process caused \\\"process_linux.go:359:
container init caused \\\\\\\"rootfs_linux.go:53: mounting \\\\\\\\\\\\\\\"/dockerdata-nfs/onap/portal/portal-fe/webapps/etc/ECOMPPORTALAPP/logback.xml\\\\\\\\\\\\\\\" to rootfs \\\\\\\\\\\\\\\"/var/lib/docker/aufs/mnt/19b3ab42adfccb997d61ee1ce74e3fe069cae7827842d08824be562b92825407\\\\\\\\\\\\\\\" at \\\\\\\\\\\\\\\"/var/lib/docker/aufs/mnt/19b3ab42adfccb997d61ee1ce74e3fe069cae7827842d08824be562b92825407/opt/apache-tomcat-8.0.37/webapps/ECOMPPORTAL/WEB-INF/classes/logback.xml\\\\\\\\\\\\\\\" caused \\\\\\\\\\\\\\\"not a directory\\\\\\\\\\\\\\\"\\\\\\\"\\\"\\n\""}
Error syncing pod
Back-off restarting failed container
root@ip-172-31-93-122:~/oom_20170908/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -a | grep portal
onap-portal portalapps-547103982-zqn8g 0/1 Init:0/2 0 9s
onap-portal portaldb-2714869748-sfw7d 0/1 ContainerCreating 0 9s
onap-portal portalwidgets-1728801515-h2b3r 0/1 Init:0/1 0 9s
onap-portal vnc-portal-1920917086-9tzcs 0/1 Init:0/5 0 8s
onap-sdnc sdnc-portal-4253352894-4hkpv 1/1 Running 0 23h
root@ip-172-31-93-122:~/oom_20170908/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -a | grep portal
onap-portal portalapps-547103982-zqn8g 0/1 Init:0/2 0 22s
onap-portal portaldb-2714869748-sfw7d 1/1 Running 0 22s
onap-portal portalwidgets-1728801515-h2b3r 0/1 Init:0/1 0 22s
onap-portal vnc-portal-1920917086-9tzcs 0/1 Init:0/5 0 21s
onap-sdnc sdnc-portal-4253352894-4hkpv 1/1 Running 0 23h
root@ip-172-31-93-122:~/oom_20170908/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -a | grep portal
onap-portal portalapps-547103982-zqn8g 0/1 Running 0 30s
onap-portal portaldb-2714869748-sfw7d 1/1 Running 0 30s
onap-portal portalwidgets-1728801515-h2b3r 0/1 Running 0 30s
onap-portal vnc-portal-1920917086-9tzcs 0/1 Init:0/5 0 29s
onap-sdnc sdnc-portal-4253352894-4hkpv 1/1 Running 0 23h
root@ip-172-31-93-122:~/oom_20170908/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -a | grep portal
onap-portal portalapps-547103982-zqn8g 0/1 Running 0 34s
onap-portal portaldb-2714869748-sfw7d 1/1 Running 0 34s
onap-portal portalwidgets-1728801515-h2b3r 0/1 Running 0 34s
onap-portal vnc-portal-1920917086-9tzcs 0/1 Init:0/5 0 33s
onap-sdnc sdnc-portal-4253352894-4hkpv 1/1 Running 0 23h
root@ip-172-31-93-122:~/oom_20170908/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -a | grep portal
onap-portal portalapps-547103982-zqn8g 1/1 Running 0 42s
onap-portal portaldb-2714869748-sfw7d 1/1 Running 0 42s
onap-portal portalwidgets-1728801515-h2b3r 1/1 Running 0 42s
onap-portal vnc-portal-1920917086-9tzcs 0/1 Init:1/5 0 41s
onap-sdnc sdnc-portal-4253352894-4hkpv 1/1 Running 0 23h
root@ip-172-31-93-122:~/oom_20170908/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -a | grep portal
onap-portal portalapps-547103982-zqn8g 1/1 Running 0 48s
onap-portal portaldb-2714869748-sfw7d 1/1 Running 0 48s
onap-portal portalwidgets-1728801515-h2b3r 1/1 Running 0 48s
onap-portal vnc-portal-1920917086-9tzcs 0/1 Init:3/5 0 47s
onap-sdnc sdnc-portal-4253352894-4hkpv 1/1 Running 0 23h
root@ip-172-31-93-122:~/oom_20170908/oom/kubernetes/oneclick# kubectl get pods --all-namespaces -a | grep portal
onap-portal portalapps-547103982-zqn8g 1/1 Running 0 55s
onap-portal portaldb-2714869748-sfw7d 1/1 Running 0 55s
onap-portal portalwidgets-1728801515-h2b3r 1/1 Running 0 55s
onap-portal vnc-portal-1920917086-9tzcs 1/1 Running 0 54s
onap-sdnc sdnc-portal-4253352894-4hkpv 1/1 Running 0 23h
- relates to
-
LOG-52
Expose LOG Volume via /dockerdata-nfs (temporary)
-
- Closed
-