Details
-
Bug
-
Status: Closed
-
Highest
-
Resolution: Done
-
Dublin Release
-
None
-
Integration-OOM-Daily
Description
Deployed ONAP with OOM master. SDC failed healthcheck and sdc-be-config-backend pod failed as well.
root@release-rancher:~# oom/kubernetes/robot/ete-k8s.sh onap health
++ export NAMESPACE=onap
++ NAMESPACE=onap
+++ kubectl --namespace onap get pods
+++ sed 's/ .*//'
+++ grep robot
++ POD=dev-robot-robot-7b46f9fd7c-b2gnb
++ TAGS='-i health'
++ ETEHOME=/var/opt/ONAP
+++ kubectl --namespace onap exec dev-robot-robot-7b46f9fd7c-b2gnb – bash -c 'ls -1q /share/logs/ | wc -l'
^Croot@release-rancher:~#
root@release-rancher:~#
root@release-rancher:~# oom/kubernetes/robot/ete-k8s.sh onap health-sdc
++ export NAMESPACE=onap
++ NAMESPACE=onap
+++ kubectl --namespace onap get pods
+++ sed 's/ .*//'
+++ grep robot
++ POD=dev-robot-robot-7b46f9fd7c-b2gnb
++ TAGS='-i health-sdc'
++ ETEHOME=/var/opt/ONAP
+++ kubectl --namespace onap exec dev-robot-robot-7b46f9fd7c-b2gnb – bash -c 'ls -1q /share/logs/ | wc -l'
++ export GLOBAL_BUILD_NUMBER=11
++ GLOBAL_BUILD_NUMBER=11
+++ printf %04d 11
++ OUTPUT_FOLDER=0011_ete_health-sdc
++ DISPLAY_NUM=101
++ VARIABLEFILES='-V /share/config/vm_properties.py -V /share/config/integration_robot_properties.py -V /share/config/integration_preload_parameters.py'
++ VARIABLES='-v GLOBAL_BUILD_NUMBER:11936'
++ kubectl --namespace onap exec dev-robot-robot-7b46f9fd7c-b2gnb – /var/opt/ONAP/runTags.sh -V /share/config/vm_properties.py -V /share/config/integration_robot_properties.py -V /share/config/integration_preload_parameters.py -v GLOBAL_BUILD_NUMBER:11936 -d /share/logs/0011_ete_health-sdc -i health-sdc --display 101
Starting Xvfb on display :101 with res 1280x1024x24
Executing robot tests at log level TRACE
==============================================================================
Testsuites
==============================================================================
Testsuites.Health-Check :: Testing ecomp components are available via calls.
==============================================================================
Basic SDC Health Check | FAIL |
Test timeout 10 seconds exceeded.
------------------------------------------------------------------------------
Testsuites.Health-Check :: Testing ecomp components are available ... | FAIL |
1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed
==============================================================================
Testsuites | FAIL |
1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed
==============================================================================
Output: /share/logs/0011_ete_health-sdc/output.xml
Log: /share/logs/0011_ete_health-sdc/log.html
Report: /share/logs/0011_ete_health-sdc/report.html
command terminated with exit code 1
root@release-rancher:~#
root@release-rancher:~# kubectl n onap get pod |grep sdc
dev-sdc-sdc-be-5c9999dfc5-b6rcp 2/2 Running 0 169m
dev-sdc-sdc-be-config-backend-8trgv 0/1 Init:Error 0 158m
dev-sdc-sdc-be-config-backend-blz56 0/1 Error 0 74m
dev-sdc-sdc-be-config-backend-crg5p 0/1 Error 0 38m
dev-sdc-sdc-be-config-backend-dntz4 0/1 Error 0 56m
dev-sdc-sdc-be-config-backend-dq2wx 0/1 Error 0 32m
dev-sdc-sdc-be-config-backend-fq6fq 0/1 Error 0 137m
dev-sdc-sdc-be-config-backend-hb5fw 0/1 Error 0 50m
dev-sdc-sdc-be-config-backend-hv7jf 0/1 Error 0 26m
dev-sdc-sdc-be-config-backend-khmsr 0/1 Init:Error 0 148m
dev-sdc-sdc-be-config-backend-plnf8 0/1 Init:Error 0 169m
dev-sdc-sdc-be-config-backend-q24gj 0/1 Error 0 44m
dev-sdc-sdc-be-config-backend-q98st 0/1 Error 0 62m
dev-sdc-sdc-be-config-backend-qhl2d 0/1 Error 0 80m
dev-sdc-sdc-be-config-backend-rzf9w 0/1 Error 0 20m
dev-sdc-sdc-be-config-backend-wkmnc 0/1 Error 0 8m52s
dev-sdc-sdc-be-config-backend-wtgk5 0/1 Error 0 14m
dev-sdc-sdc-be-config-backend-zcsnf 0/1 Error 0 68m
dev-sdc-sdc-cs-config-cassandra-57m7m 0/1 Error 0 169m
dev-sdc-sdc-cs-config-cassandra-ctnx7 0/1 Completed 0 167m
dev-sdc-sdc-dcae-be-6dd4df6cf6-ldt5r 0/2 Init:1/2 16 169m
dev-sdc-sdc-dcae-be-tools-5h9w9 0/1 Init:Error 0 148m
dev-sdc-sdc-dcae-be-tools-6xbbk 0/1 Init:Error 0 14m
dev-sdc-sdc-dcae-be-tools-7st7c 0/1 Init:Error 0 80m
dev-sdc-sdc-dcae-be-tools-7vmvf 0/1 Init:Error 0 63m
dev-sdc-sdc-dcae-be-tools-bhn6s 0/1 Init:Error 0 158m
dev-sdc-sdc-dcae-be-tools-bp6pf 0/1 Init:Error 0 112m
dev-sdc-sdc-dcae-be-tools-jgmjw 0/1 Init:Error 0 136m
dev-sdc-sdc-dcae-be-tools-khqsd 0/1 Init:Error 0 125m
dev-sdc-sdc-dcae-be-tools-l6n4r 0/1 Init:Error 0 169m
dev-sdc-sdc-dcae-be-tools-mq55c 0/1 Init:Error 0 96m
dev-sdc-sdc-dcae-be-tools-qmnhc 0/1 Init:Error 0 46m
dev-sdc-sdc-dcae-be-tools-s8qh6 0/1 Init:Error 0 30m
dev-sdc-sdc-dcae-dt-6f669b4d4c-jvvxq 0/2 Init:0/2 16 169m
dev-sdc-sdc-dcae-fe-684f4495b7-dwg8k 0/2 Init:0/2 16 169m
dev-sdc-sdc-dcae-tosca-lab-74cf68f5ff-ljv74 0/2 Init:0/1 16 169m
dev-sdc-sdc-es-6cd79f46c7-nntv4 1/1 Running 0 169m
dev-sdc-sdc-es-config-elasticsearch-sr7ks 0/1 Completed 0 169m
dev-sdc-sdc-fe-5468d59666-xcfh6 0/2 Init:1/2 15 169m
dev-sdc-sdc-kb-dddcf6778-jvwlr 1/1 Running 0 169m
dev-sdc-sdc-onboarding-be-6fb8f5547d-xvjb6 2/2 Running 0 169m
dev-sdc-sdc-onboarding-be-cassandra-init-2bx5n 0/1 Completed 0 158m
dev-sdc-sdc-onboarding-be-cassandra-init-wrmd7 0/1 Init:Error 0 169m
dev-sdc-sdc-wfd-be-779869944d-6zgsg 0/1 Running 37 169m
dev-sdc-sdc-wfd-be-workflow-init-s9k9s 0/1 Init:Error 0 169m
dev-sdc-sdc-wfd-be-workflow-init-t5n2x 0/1 Completed 0 159m
dev-sdc-sdc-wfd-fe-7b4bbc666d-h8qr7 0/2 Init:0/1 16 169m