-
Bug
-
Resolution: Done
-
High
-
Beijing Release
-
None
-
Integration lab
-
SDNC Dublin Spr 3 3/11 - 3/29, SDNC El Alto Sprint 1
http://jenkins.onap.info/job/oom-cd-master/2863/console
ubuntu@ip-10-0-0-19:~/oom/kubernetes/robot$ ./ete-k8s.sh onap health
ls: cannot access '/share/logs/': No such file or directory
Starting Xvfb on display :88 with res 1280x1024x24
Executing robot tests at log level TRACE
==============================================================================
OpenECOMP ETE
==============================================================================
OpenECOMP ETE.Robot
==============================================================================
OpenECOMP ETE.Robot.Testsuites
==============================================================================
[ ERROR ] Error in file '/var/opt/OpenECOMP_ETE/robot/resources/oof_interface.robot': Setting variable '${OOF_HOMING_ENDPOINT}' failed: Variable '${GLOBAL_OOF_SERVER_PROTOCOL}' not found. Did you mean:
${GLOBAL_MSO_SERVER_PROTOCOL}
${GLOBAL_LOG_SERVER_PROTOCOL}
${GLOBAL_MR_SERVER_PROTOCOL}
${GLOBAL_VID_SERVER_PROTOCOL}
${GLOBAL_NBI_SERVER_PROTOCOL}
${GLOBAL_MSB_SERVER_PROTOCOL}
${GLOBAL_CLI_SERVER_PROTOCOL}
${GLOBAL_AAI_SERVER_PROTOCOL}
${GLOBAL_VNFSDK_SERVER_PROTOCOL}
${GLOBAL_PORTAL_SERVER_PROTOCOL}
[ ERROR ] Error in file '/var/opt/OpenECOMP_ETE/robot/resources/oof_interface.robot': Setting variable '${OOF_SNIRO_ENDPOINT}' failed: Variable '${GLOBAL_OOF_SERVER_PROTOCOL}' not found. Did you mean:
${GLOBAL_MSO_SERVER_PROTOCOL}
${GLOBAL_LOG_SERVER_PROTOCOL}
${GLOBAL_MR_SERVER_PROTOCOL}
${GLOBAL_VID_SERVER_PROTOCOL}
${GLOBAL_NBI_SERVER_PROTOCOL}
${GLOBAL_MSB_SERVER_PROTOCOL}
${GLOBAL_CLI_SERVER_PROTOCOL}
${GLOBAL_AAI_SERVER_PROTOCOL}
${GLOBAL_VNFSDK_SERVER_PROTOCOL}
${GLOBAL_PORTAL_SERVER_PROTOCOL}
OpenECOMP ETE.Robot.Testsuites.Health-Check :: Testing ecomp components are...
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF Health Check [ WARN ] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c972ba10>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /authz/perms/user/dgl@openecomp.org
[ WARN ] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c97348d0>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /authz/perms/user/dgl@openecomp.org
[ WARN ] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c9734310>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /authz/perms/user/dgl@openecomp.org
| FAIL |
ConnectionError: HTTPConnectionPool(host='aaf.onap', port=8101): Max retries exceeded with url: /authz/perms/user/dgl@openecomp.org (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c98b6450>: Failed to establish a new connection: [Errno -2] Name or service not known',))
------------------------------------------------------------------------------
Basic APPC Health Check | PASS |
------------------------------------------------------------------------------
Basic CLI Health Check | PASS |
------------------------------------------------------------------------------
Basic CLAMP Health Check | PASS |
------------------------------------------------------------------------------
Basic DCAE Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic External API NBI Health Check [ WARN ] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c9757410>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v1/status
[ WARN ] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c9757610>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v1/status
[ WARN ] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c9757810>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v1/status
| FAIL |
ConnectionError: HTTPConnectionPool(host='nbi.onap', port=8080): Max retries exceeded with url: /nbi/api/v1/status (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c97579d0>: Failed to establish a new connection: [Errno -2] Name or service not known',))
------------------------------------------------------------------------------
Basic Log Elasticsearch Health Check | PASS |
------------------------------------------------------------------------------
Basic Log Kibana Health Check | FAIL |
Test timeout 1 minute exceeded.
------------------------------------------------------------------------------
Basic Log Logstash Health Check | PASS |
------------------------------------------------------------------------------
Basic Microservice Bus Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-ocata API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-titanium_cloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-vio API Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-Homing Health Check | FAIL |
Variable '${OOF_HOMING_ENDPOINT}' not found.
------------------------------------------------------------------------------
Basic OOF-SNIRO Health Check | FAIL |
Variable '${OOF_SNIRO_ENDPOINT}' not found.
------------------------------------------------------------------------------
Basic Policy Health Check | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | FAIL |
Test timeout 1 minute exceeded.
------------------------------------------------------------------------------
Basic SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | FAIL |
Resolving variable '${resp.json()['output']['response-code']}' failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
------------------------------------------------------------------------------
Basic SO Health Check | FAIL |
503 != 200
------------------------------------------------------------------------------
Basic UseCaseUI API Health Check | FAIL |
502 != 200
------------------------------------------------------------------------------
Basic VFC catalog API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC emsdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC gvnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC huaweivnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC jujuvnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC multivimproxy API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC nokiavnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC nokiav2driver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC nslcm API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC resmgr API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnflcm API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnfmgr API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnfres API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC workflow API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC ztesdncdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC ztevnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VID Health Check | PASS |
------------------------------------------------------------------------------
Basic VNFSDK Health Check | PASS |
------------------------------------------------------------------------------
OpenECOMP ETE.Robot.Testsuites.Health-Check :: Testing ecomp compo... | FAIL |
42 critical tests, 33 passed, 9 failed
42 tests total, 33 passed, 9 failed
==============================================================================
OpenECOMP ETE.Robot.Testsuites | FAIL |
42 critical tests, 33 passed, 9 failed
42 tests total, 33 passed, 9 failed
==============================================================================
OpenECOMP ETE.Robot | FAIL |
42 critical tests, 33 passed, 9 failed
42 tests total, 33 passed, 9 failed
==============================================================================
OpenECOMP ETE | FAIL |
42 critical tests, 33 passed, 9 failed
42 tests total, 33 passed, 9 failed
==============================================================================
Output: /share/logs/ETE_0000_health/output.xml
Log: /share/logs/ETE_0000_health/log.html
Report: /share/logs/ETE_0000_health/report.html
command terminated with exit code 9
ubuntu@ip-10-0-0-19:~/oom/kubernetes/robot$ kubectl get pods --all-namespaces | grep 0/
onap onap-aaf-586b756997-znphs 0/1 CrashLoopBackOff 9 28m
onap onap-dcae-redis-5 0/1 CrashLoopBackOff 8 22m
onap onap-log-kibana-6bb55fc66b-4qhmg 0/1 Running 2 14m
onap onap-portal-app-558d99bcd4-98zvz 0/2 Init:0/1 1 18m
ubuntu@ip-10-0-0-19:~/oom/kubernetes/robot$ kubectl get pods --all-namespaces | grep 1/2
ubuntu@ip-10-0-0-19:~/oom/kubernetes/robot$ kubectl get pods --all-namespaces
NAMESPACE NAME READY STATUS RESTARTS AGE
dcae dep-config-binding-service-7cccc757bd-gwsmk 2/2 Running 0 1h
dcae dep-dcae-ves-collector-555b68fb89-8kg4r 2/2 Running 0 52m
dcae dep-deployment-handler-54bbc89b7d-h4jfw 2/2 Running 0 58m
dcae dep-inventory-69bfbf8d55-g6tpb 1/1 Running 0 1h
dcae dep-policy-handler-5d988dc5f-ws7gb 2/2 Running 0 54m
dcae dep-pstg-write-787c4bb65b-r4j5b 1/1 Running 0 1h
dcae dep-sa1e86e6d2a4e4b43a755096bd19c4ed7-dcaegen2-analytics-tj26w4 2/2 Running 0 52m
dcae dep-service-change-handler-548cc6c5f5-zd4hj 1/1 Running 2 1h
kube-system heapster-76b8cd7b5-ttspf 1/1 Running 0 14h
kube-system kube-dns-5d7b4487c9-6xhtn 3/3 Running 0 9h
kube-system kubernetes-dashboard-f9577fffd-4cr2m 1/1 Running 0 8h
kube-system monitoring-grafana-997796fcf-ps475 1/1 Running 0 11h
kube-system monitoring-influxdb-56fdcd96b-v2s75 1/1 Running 0 10h
kube-system tiller-deploy-54bcc55dd5-2w6lv 1/1 Running 0 9h
onap onap-aaf-586b756997-znphs 0/1 Running 10 33m
onap onap-aaf-cs-5848b85565-68q4t 1/1 Running 0 1h
onap onap-aaf-sms-5f5f65c75-2phzw 1/1 Running 2 1h
onap onap-aaf-sms-quorumclient-0 1/1 Running 0 1h
onap onap-aaf-sms-quorumclient-1 1/1 Running 0 1h
onap onap-aaf-sms-quorumclient-2 1/1 Running 0 1h
onap onap-aaf-sms-vault-0 2/2 Running 1 1h
onap onap-aai-58db756c8f-zn6r9 1/1 Running 0 1h
onap onap-aai-babel-f7c8549b4-slfbt 1/1 Running 0 1h
onap onap-aai-cassandra-0 1/1 Running 0 1h
onap onap-aai-cassandra-1 1/1 Running 0 1h
onap onap-aai-cassandra-2 1/1 Running 0 1h
onap onap-aai-champ-849c4c97b9-5d2jt 1/1 Running 0 1h
onap onap-aai-data-router-586db9d945-kwm4v 1/1 Running 0 1h
onap onap-aai-elasticsearch-5668d555d7-2qn9v 1/1 Running 0 1h
onap onap-aai-gizmo-94496fb79-s98ld 2/2 Running 0 1h
onap onap-aai-hbase-db48bf969-fb86v 1/1 Running 0 1h
onap onap-aai-modelloader-5f54fdc5b7-ccn6p 2/2 Running 0 1h
onap onap-aai-resources-78ffb7b6c6-pd9fx 2/2 Running 0 1h
onap onap-aai-search-data-655b565b7c-dhrcr 2/2 Running 0 1h
onap onap-aai-sparky-be-5455fd7c4b-nlccg 2/2 Running 0 1h
onap onap-aai-traversal-76977574f5-q79l6 2/2 Running 0 1h
onap onap-appc-0 2/2 Running 0 29m
onap onap-appc-1 2/2 Running 0 1h
onap onap-appc-2 2/2 Running 0 1h
onap onap-appc-cdt-746fc94667-slfpl 1/1 Running 0 1h
onap onap-appc-db-0 2/2 Running 0 1h
onap onap-appc-dgbuilder-6bbd4dbdcd-zx9zq 1/1 Running 0 1h
onap onap-brmsgw-674c85d694-8p65q 1/1 Running 0 1h
onap onap-clamp-654974b99b-8skvd 1/1 Running 0 1h
onap onap-clampdb-9cfb679f6-7bpvz 1/1 Running 1 1h
onap onap-cli-5858859bcf-f9lmd 1/1 Running 0 1h
onap onap-consul-767c54c595-9g2qg 1/1 Running 4 1h
onap onap-consul-server-65c5bdf564-9zz67 1/1 Running 0 1h
onap onap-dbcl-db-0 1/1 Running 1 1h
onap onap-dbcl-db-1 1/1 Running 3 1h
onap onap-dcae-cloudify-manager-854dbcdb4b-24dtb 1/1 Running 0 1h
onap onap-dcae-db-0 1/1 Running 0 1h
onap onap-dcae-db-1 1/1 Running 1 1h
onap onap-dcae-healthcheck-7779c4d877-nf754 1/1 Running 0 1h
onap onap-dcae-redis-0 1/1 Running 0 1h
onap onap-dcae-redis-1 1/1 Running 0 1h
onap onap-dcae-redis-2 1/1 Running 0 1h
onap onap-dcae-redis-3 1/1 Running 0 1h
onap onap-dcae-redis-4 1/1 Running 0 28m
onap onap-dcae-redis-5 0/1 CrashLoopBackOff 9 27m
onap onap-dmaap-68c456b7f5-w667h 1/1 Running 0 1h
onap onap-dmaap-bus-controller-67d4dcb9b-v8zqw 1/1 Running 0 1h
onap onap-drools-0 1/1 Running 1 1h
onap onap-drools-1 1/1 Running 0 1h
onap onap-drools-2 1/1 Running 0 54m
onap onap-drools-3 1/1 Running 0 45m
onap onap-esr-7b9b857687-5qwfl 2/2 Running 0 1h
onap onap-esr-gui-58559748bd-58rlv 1/1 Running 0 1h
onap onap-global-kafka-6bd8547fd9-msqhz 1/1 Running 0 1h
onap onap-kube2msb-5997c9fff9-lgvs5 1/1 Running 0 1h
onap onap-log-elasticsearch-756cfb559b-tpwh2 1/1 Running 1 1h
onap onap-log-kibana-6bb55fc66b-4qhmg 0/1 Running 4 19m
onap onap-log-logstash-689ccb995c-kk4b5 1/1 Running 0 1h
onap onap-msb-consul-5f79c7fd47-pxlfl 1/1 Running 0 1h
onap onap-msb-discovery-7c9997b5c8-spgsx 2/2 Running 0 1h
onap onap-msb-eag-5ffccbf65-hfsq5 2/2 Running 0 1h
onap onap-msb-iag-6cf5b697f8-m64jz 2/2 Running 0 1h
onap onap-multicloud-74dd956665-2xwvq 2/2 Running 0 1h
onap onap-multicloud-ocata-644b48999c-jpqmr 2/2 Running 0 1h
onap onap-multicloud-vio-786d8f8c88-sj7s6 2/2 Running 0 1h
onap onap-multicloud-windriver-99bdd58df-5zmxk 2/2 Running 0 1h
onap onap-nexus-54ddfc9497-qmqqb 1/1 Running 1 1h
onap onap-pap-7d5b98f968-hx2g9 2/2 Running 0 1h
onap onap-pdp-0 2/2 Running 0 1h
onap onap-pdp-1 2/2 Running 0 1h
onap onap-policydb-79488ffb96-vl2n7 1/1 Running 0 1h
onap onap-portal-app-558d99bcd4-98zvz 0/2 Init:0/1 2 23m
onap onap-portal-cassandra-57fb4c797f-rkjr9 1/1 Running 0 1h
onap onap-portal-db-787888c89b-46ph4 1/1 Running 1 1h
onap onap-portal-sdk-7f855d46d4-89fpw 2/2 Running 0 1h
onap onap-portal-widget-585cf754db-nk4jf 1/1 Running 0 1h
onap onap-portal-zookeeper-696c5f95cb-854cj 1/1 Running 0 1h
onap onap-robot-6d96c57bfb-fn9tn 1/1 Running 0 1h
onap onap-sdc-be-f59ccf7c9-mztgq 2/2 Running 0 1h
onap onap-sdc-cs-6746876cc5-nr8bv 1/1 Running 0 1h
onap onap-sdc-es-b64bfb94d-876dr 1/1 Running 0 1h
onap onap-sdc-fe-75b8fcb4fd-zskkl 2/2 Running 0 1h
onap onap-sdc-kb-7f4c88b89c-qx7d2 1/1 Running 0 1h
onap onap-sdc-onboarding-be-6656f56dc4-xbt22 2/2 Running 0 1h
onap onap-sdc-wfd-7b894c74cc-7q2np 1/1 Running 0 1h
onap onap-sdnc-0 2/2 Running 0 1h
onap onap-sdnc-db-0 2/2 Running 0 1h
onap onap-sdnc-dgbuilder-76589b66b6-n64cw 1/1 Running 0 1h
onap onap-sdnc-dmaap-listener-7d69d49655-kf67c 1/1 Running 0 1h
onap onap-sdnc-portal-696f4979c9-sf8kq 1/1 Running 12 1h
onap onap-sdnc-ueb-listener-74fdb45df7-8pbqr 1/1 Running 0 1h
onap onap-so-db-5974c48944-vxmpr 1/1 Running 1 1h
onap onap-so-f77449fcd-vk788 2/2 Running 0 32m
onap onap-uui-66fc98dbd8-stlbk 1/1 Running 0 1h
onap onap-uui-server-67d6dfbff9-chzp5 1/1 Running 1 1h
onap onap-vfc-catalog-76f9b55876-mh2p9 2/2 Running 10 1h
onap onap-vfc-ems-driver-768b8ddfb-t4mhb 1/1 Running 5 1h
onap onap-vfc-generic-vnfm-driver-7c756bdb7-m2djr 2/2 Running 0 1h
onap onap-vfc-huawei-vnfm-driver-5f8588fb6-qf7jz 2/2 Running 0 1h
onap onap-vfc-juju-vnfm-driver-847bf77dbf-xhh97 2/2 Running 0 1h
onap onap-vfc-multivim-proxy-84bff94c6f-8fqk5 1/1 Running 2 1h
onap onap-vfc-nokia-v2vnfm-driver-79895d86f5-fpdtb 1/1 Running 0 1h
onap onap-vfc-nokia-vnfm-driver-6b6d44cbbd-ngnzf 2/2 Running 0 1h
onap onap-vfc-nslcm-64cf4b9d8c-mq9v2 2/2 Running 0 1h
onap onap-vfc-resmgr-6c46c8c67b-2mhv4 2/2 Running 0 1h
onap onap-vfc-vnflcm-666b4957c9-zblkb 2/2 Running 0 1h
onap onap-vfc-vnfmgr-85b66cbb7f-xllxs 2/2 Running 0 1h
onap onap-vfc-vnfres-bd5c75d-5d847 2/2 Running 11 1h
onap onap-vfc-workflow-79dbbf8c6c-9g5hh 1/1 Running 3 1h
onap onap-vfc-workflow-engine-676d97fbb6-xlgrl 1/1 Running 2 1h
onap onap-vfc-zte-sdnc-driver-6b95d94875-9gg6m 1/1 Running 10 1h
onap onap-vfc-zte-vnfm-driver-6c9d489c44-nqbg9 2/2 Running 0 1h
onap onap-vid-84f89777d6-rskkr 2/2 Running 0 1h
onap onap-vid-mariadb-866fc74f8b-ldnpr 1/1 Running 0 1h
onap onap-vnfsdk-c48b5479-kmj7v 1/1 Running 0 1h
onap onap-vnfsdk-postgres-6f8b9bf77f-phjwk 1/1 Running 0 1h
onap onap-zookeeper-64df556db-cjsjr 1/1 Running 0 1h
onap sniro-emulator-7fc8658bcb-hkzpf 1/1 Running 0 1h