Uploaded image for project: 'Network Controller'
  1. Network Controller
  2. SDNC-304

SDNC OOM intermittent Healthcheck failure - JSONDecodeError - on different startup order

    Details

    • Sprint:
      SDNC Dublin Spr 3 3/11 - 3/29, SDNC El Alto Sprint 1

      Description

      http://jenkins.onap.info/job/oom-cd-master/2863/console

      ubuntu@ip-10-0-0-19:~/oom/kubernetes/robot$ ./ete-k8s.sh onap health
      ls: cannot access '/share/logs/': No such file or directory
      Starting Xvfb on display :88 with res 1280x1024x24
      Executing robot tests at log level TRACE
      ==============================================================================
      OpenECOMP ETE                                                                 
      ==============================================================================
      OpenECOMP ETE.Robot                                                           
      ==============================================================================
      OpenECOMP ETE.Robot.Testsuites                                                
      ==============================================================================
      [ ERROR ] Error in file '/var/opt/OpenECOMP_ETE/robot/resources/oof_interface.robot': Setting variable '${OOF_HOMING_ENDPOINT}' failed: Variable '${GLOBAL_OOF_SERVER_PROTOCOL}' not found. Did you mean:
          ${GLOBAL_MSO_SERVER_PROTOCOL}
          ${GLOBAL_LOG_SERVER_PROTOCOL}
          ${GLOBAL_MR_SERVER_PROTOCOL}
          ${GLOBAL_VID_SERVER_PROTOCOL}
          ${GLOBAL_NBI_SERVER_PROTOCOL}
          ${GLOBAL_MSB_SERVER_PROTOCOL}
          ${GLOBAL_CLI_SERVER_PROTOCOL}
          ${GLOBAL_AAI_SERVER_PROTOCOL}
          ${GLOBAL_VNFSDK_SERVER_PROTOCOL}
          ${GLOBAL_PORTAL_SERVER_PROTOCOL}
      [ ERROR ] Error in file '/var/opt/OpenECOMP_ETE/robot/resources/oof_interface.robot': Setting variable '${OOF_SNIRO_ENDPOINT}' failed: Variable '${GLOBAL_OOF_SERVER_PROTOCOL}' not found. Did you mean:
          ${GLOBAL_MSO_SERVER_PROTOCOL}
          ${GLOBAL_LOG_SERVER_PROTOCOL}
          ${GLOBAL_MR_SERVER_PROTOCOL}
          ${GLOBAL_VID_SERVER_PROTOCOL}
          ${GLOBAL_NBI_SERVER_PROTOCOL}
          ${GLOBAL_MSB_SERVER_PROTOCOL}
          ${GLOBAL_CLI_SERVER_PROTOCOL}
          ${GLOBAL_AAI_SERVER_PROTOCOL}
          ${GLOBAL_VNFSDK_SERVER_PROTOCOL}
          ${GLOBAL_PORTAL_SERVER_PROTOCOL}
      OpenECOMP ETE.Robot.Testsuites.Health-Check :: Testing ecomp components are...
      ==============================================================================
      Basic A&AI Health Check                                               | PASS |
      ------------------------------------------------------------------------------
      Basic AAF Health Check                                                [ WARN ] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c972ba10>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /authz/perms/user/dgl@openecomp.org
      [ WARN ] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c97348d0>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /authz/perms/user/dgl@openecomp.org
      [ WARN ] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c9734310>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /authz/perms/user/dgl@openecomp.org
      | FAIL |
      ConnectionError: HTTPConnectionPool(host='aaf.onap', port=8101): Max retries exceeded with url: /authz/perms/user/dgl@openecomp.org (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c98b6450>: Failed to establish a new connection: [Errno -2] Name or service not known',))
      ------------------------------------------------------------------------------
      Basic APPC Health Check                                               | PASS |
      ------------------------------------------------------------------------------
      Basic CLI Health Check                                                | PASS |
      ------------------------------------------------------------------------------
      Basic CLAMP Health Check                                              | PASS |
      ------------------------------------------------------------------------------
      Basic DCAE Health Check                                               | PASS |
      ------------------------------------------------------------------------------
      Basic DMAAP Message Router Health Check                               | PASS |
      ------------------------------------------------------------------------------
      Basic External API NBI Health Check                                   [ WARN ] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c9757410>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v1/status
      [ WARN ] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c9757610>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v1/status
      [ WARN ] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c9757810>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v1/status
      | FAIL |
      ConnectionError: HTTPConnectionPool(host='nbi.onap', port=8080): Max retries exceeded with url: /nbi/api/v1/status (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f09c97579d0>: Failed to establish a new connection: [Errno -2] Name or service not known',))
      ------------------------------------------------------------------------------
      Basic Log Elasticsearch Health Check                                  | PASS |
      ------------------------------------------------------------------------------
      Basic Log Kibana Health Check                                         | FAIL |
      Test timeout 1 minute exceeded.
      ------------------------------------------------------------------------------
      Basic Log Logstash Health Check                                       | PASS |
      ------------------------------------------------------------------------------
      Basic Microservice Bus Health Check                                   | PASS |
      ------------------------------------------------------------------------------
      Basic Multicloud API Health Check                                     | PASS |
      ------------------------------------------------------------------------------
      Basic Multicloud-ocata API Health Check                               | PASS |
      ------------------------------------------------------------------------------
      Basic Multicloud-titanium_cloud API Health Check                      | PASS |
      ------------------------------------------------------------------------------
      Basic Multicloud-vio API Health Check                                 | PASS |
      ------------------------------------------------------------------------------
      Basic OOF-Homing Health Check                                         | FAIL |
      Variable '${OOF_HOMING_ENDPOINT}' not found.
      ------------------------------------------------------------------------------
      Basic OOF-SNIRO Health Check                                          | FAIL |
      Variable '${OOF_SNIRO_ENDPOINT}' not found.
      ------------------------------------------------------------------------------
      Basic Policy Health Check                                             | PASS |
      ------------------------------------------------------------------------------
      Basic Portal Health Check                                             | FAIL |
      Test timeout 1 minute exceeded.
      ------------------------------------------------------------------------------
      Basic SDC Health Check                                                | PASS |
      ------------------------------------------------------------------------------
      Basic SDNC Health Check                                               | FAIL |
      Resolving variable '${resp.json()['output']['response-code']}' failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0)
      ------------------------------------------------------------------------------
      Basic SO Health Check                                                 | FAIL |
      503 != 200
      ------------------------------------------------------------------------------
      Basic UseCaseUI API Health Check                                      | FAIL |
      502 != 200
      ------------------------------------------------------------------------------
      Basic VFC catalog API Health Check                                    | PASS |
      ------------------------------------------------------------------------------
      Basic VFC emsdriver API Health Check                                  | PASS |
      ------------------------------------------------------------------------------
      Basic VFC gvnfmdriver API Health Check                                | PASS |
      ------------------------------------------------------------------------------
      Basic VFC huaweivnfmdriver API Health Check                           | PASS |
      ------------------------------------------------------------------------------
      Basic VFC jujuvnfmdriver API Health Check                             | PASS |
      ------------------------------------------------------------------------------
      Basic VFC multivimproxy API Health Check                              | PASS |
      ------------------------------------------------------------------------------
      Basic VFC nokiavnfmdriver API Health Check                            | PASS |
      ------------------------------------------------------------------------------
      Basic VFC nokiav2driver API Health Check                              | PASS |
      ------------------------------------------------------------------------------
      Basic VFC nslcm API Health Check                                      | PASS |
      ------------------------------------------------------------------------------
      Basic VFC resmgr API Health Check                                     | PASS |
      ------------------------------------------------------------------------------
      Basic VFC vnflcm API Health Check                                     | PASS |
      ------------------------------------------------------------------------------
      Basic VFC vnfmgr API Health Check                                     | PASS |
      ------------------------------------------------------------------------------
      Basic VFC vnfres API Health Check                                     | PASS |
      ------------------------------------------------------------------------------
      Basic VFC workflow API Health Check                                   | PASS |
      ------------------------------------------------------------------------------
      Basic VFC ztesdncdriver API Health Check                              | PASS |
      ------------------------------------------------------------------------------
      Basic VFC ztevnfmdriver API Health Check                              | PASS |
      ------------------------------------------------------------------------------
      Basic VID Health Check                                                | PASS |
      ------------------------------------------------------------------------------
      Basic VNFSDK Health Check                                             | PASS |
      ------------------------------------------------------------------------------
      OpenECOMP ETE.Robot.Testsuites.Health-Check :: Testing ecomp compo... | FAIL |
      42 critical tests, 33 passed, 9 failed
      42 tests total, 33 passed, 9 failed
      ==============================================================================
      OpenECOMP ETE.Robot.Testsuites                                        | FAIL |
      42 critical tests, 33 passed, 9 failed
      42 tests total, 33 passed, 9 failed
      ==============================================================================
      OpenECOMP ETE.Robot                                                   | FAIL |
      42 critical tests, 33 passed, 9 failed
      42 tests total, 33 passed, 9 failed
      ==============================================================================
      OpenECOMP ETE                                                         | FAIL |
      42 critical tests, 33 passed, 9 failed
      42 tests total, 33 passed, 9 failed
      ==============================================================================
      Output:  /share/logs/ETE_0000_health/output.xml
      Log:     /share/logs/ETE_0000_health/log.html
      Report:  /share/logs/ETE_0000_health/report.html
      command terminated with exit code 9
      ubuntu@ip-10-0-0-19:~/oom/kubernetes/robot$ kubectl get pods --all-namespaces | grep 0/
      onap          onap-aaf-586b756997-znphs                                         0/1       CrashLoopBackOff   9          28m
      onap          onap-dcae-redis-5                                                 0/1       CrashLoopBackOff   8          22m
      onap          onap-log-kibana-6bb55fc66b-4qhmg                                  0/1       Running            2          14m
      onap          onap-portal-app-558d99bcd4-98zvz                                  0/2       Init:0/1           1          18m
      ubuntu@ip-10-0-0-19:~/oom/kubernetes/robot$ kubectl get pods --all-namespaces | grep 1/2
      ubuntu@ip-10-0-0-19:~/oom/kubernetes/robot$ kubectl get pods --all-namespaces 
      NAMESPACE     NAME                                                              READY     STATUS             RESTARTS   AGE
      dcae          dep-config-binding-service-7cccc757bd-gwsmk                       2/2       Running            0          1h
      dcae          dep-dcae-ves-collector-555b68fb89-8kg4r                           2/2       Running            0          52m
      dcae          dep-deployment-handler-54bbc89b7d-h4jfw                           2/2       Running            0          58m
      dcae          dep-inventory-69bfbf8d55-g6tpb                                    1/1       Running            0          1h
      dcae          dep-policy-handler-5d988dc5f-ws7gb                                2/2       Running            0          54m
      dcae          dep-pstg-write-787c4bb65b-r4j5b                                   1/1       Running            0          1h
      dcae          dep-sa1e86e6d2a4e4b43a755096bd19c4ed7-dcaegen2-analytics-tj26w4   2/2       Running            0          52m
      dcae          dep-service-change-handler-548cc6c5f5-zd4hj                       1/1       Running            2          1h
      kube-system   heapster-76b8cd7b5-ttspf                                          1/1       Running            0          14h
      kube-system   kube-dns-5d7b4487c9-6xhtn                                         3/3       Running            0          9h
      kube-system   kubernetes-dashboard-f9577fffd-4cr2m                              1/1       Running            0          8h
      kube-system   monitoring-grafana-997796fcf-ps475                                1/1       Running            0          11h
      kube-system   monitoring-influxdb-56fdcd96b-v2s75                               1/1       Running            0          10h
      kube-system   tiller-deploy-54bcc55dd5-2w6lv                                    1/1       Running            0          9h
      onap          onap-aaf-586b756997-znphs                                         0/1       Running            10         33m
      onap          onap-aaf-cs-5848b85565-68q4t                                      1/1       Running            0          1h
      onap          onap-aaf-sms-5f5f65c75-2phzw                                      1/1       Running            2          1h
      onap          onap-aaf-sms-quorumclient-0                                       1/1       Running            0          1h
      onap          onap-aaf-sms-quorumclient-1                                       1/1       Running            0          1h
      onap          onap-aaf-sms-quorumclient-2                                       1/1       Running            0          1h
      onap          onap-aaf-sms-vault-0                                              2/2       Running            1          1h
      onap          onap-aai-58db756c8f-zn6r9                                         1/1       Running            0          1h
      onap          onap-aai-babel-f7c8549b4-slfbt                                    1/1       Running            0          1h
      onap          onap-aai-cassandra-0                                              1/1       Running            0          1h
      onap          onap-aai-cassandra-1                                              1/1       Running            0          1h
      onap          onap-aai-cassandra-2                                              1/1       Running            0          1h
      onap          onap-aai-champ-849c4c97b9-5d2jt                                   1/1       Running            0          1h
      onap          onap-aai-data-router-586db9d945-kwm4v                             1/1       Running            0          1h
      onap          onap-aai-elasticsearch-5668d555d7-2qn9v                           1/1       Running            0          1h
      onap          onap-aai-gizmo-94496fb79-s98ld                                    2/2       Running            0          1h
      onap          onap-aai-hbase-db48bf969-fb86v                                    1/1       Running            0          1h
      onap          onap-aai-modelloader-5f54fdc5b7-ccn6p                             2/2       Running            0          1h
      onap          onap-aai-resources-78ffb7b6c6-pd9fx                               2/2       Running            0          1h
      onap          onap-aai-search-data-655b565b7c-dhrcr                             2/2       Running            0          1h
      onap          onap-aai-sparky-be-5455fd7c4b-nlccg                               2/2       Running            0          1h
      onap          onap-aai-traversal-76977574f5-q79l6                               2/2       Running            0          1h
      onap          onap-appc-0                                                       2/2       Running            0          29m
      onap          onap-appc-1                                                       2/2       Running            0          1h
      onap          onap-appc-2                                                       2/2       Running            0          1h
      onap          onap-appc-cdt-746fc94667-slfpl                                    1/1       Running            0          1h
      onap          onap-appc-db-0                                                    2/2       Running            0          1h
      onap          onap-appc-dgbuilder-6bbd4dbdcd-zx9zq                              1/1       Running            0          1h
      onap          onap-brmsgw-674c85d694-8p65q                                      1/1       Running            0          1h
      onap          onap-clamp-654974b99b-8skvd                                       1/1       Running            0          1h
      onap          onap-clampdb-9cfb679f6-7bpvz                                      1/1       Running            1          1h
      onap          onap-cli-5858859bcf-f9lmd                                         1/1       Running            0          1h
      onap          onap-consul-767c54c595-9g2qg                                      1/1       Running            4          1h
      onap          onap-consul-server-65c5bdf564-9zz67                               1/1       Running            0          1h
      onap          onap-dbcl-db-0                                                    1/1       Running            1          1h
      onap          onap-dbcl-db-1                                                    1/1       Running            3          1h
      onap          onap-dcae-cloudify-manager-854dbcdb4b-24dtb                       1/1       Running            0          1h
      onap          onap-dcae-db-0                                                    1/1       Running            0          1h
      onap          onap-dcae-db-1                                                    1/1       Running            1          1h
      onap          onap-dcae-healthcheck-7779c4d877-nf754                            1/1       Running            0          1h
      onap          onap-dcae-redis-0                                                 1/1       Running            0          1h
      onap          onap-dcae-redis-1                                                 1/1       Running            0          1h
      onap          onap-dcae-redis-2                                                 1/1       Running            0          1h
      onap          onap-dcae-redis-3                                                 1/1       Running            0          1h
      onap          onap-dcae-redis-4                                                 1/1       Running            0          28m
      onap          onap-dcae-redis-5                                                 0/1       CrashLoopBackOff   9          27m
      onap          onap-dmaap-68c456b7f5-w667h                                       1/1       Running            0          1h
      onap          onap-dmaap-bus-controller-67d4dcb9b-v8zqw                         1/1       Running            0          1h
      onap          onap-drools-0                                                     1/1       Running            1          1h
      onap          onap-drools-1                                                     1/1       Running            0          1h
      onap          onap-drools-2                                                     1/1       Running            0          54m
      onap          onap-drools-3                                                     1/1       Running            0          45m
      onap          onap-esr-7b9b857687-5qwfl                                         2/2       Running            0          1h
      onap          onap-esr-gui-58559748bd-58rlv                                     1/1       Running            0          1h
      onap          onap-global-kafka-6bd8547fd9-msqhz                                1/1       Running            0          1h
      onap          onap-kube2msb-5997c9fff9-lgvs5                                    1/1       Running            0          1h
      onap          onap-log-elasticsearch-756cfb559b-tpwh2                           1/1       Running            1          1h
      onap          onap-log-kibana-6bb55fc66b-4qhmg                                  0/1       Running            4          19m
      onap          onap-log-logstash-689ccb995c-kk4b5                                1/1       Running            0          1h
      onap          onap-msb-consul-5f79c7fd47-pxlfl                                  1/1       Running            0          1h
      onap          onap-msb-discovery-7c9997b5c8-spgsx                               2/2       Running            0          1h
      onap          onap-msb-eag-5ffccbf65-hfsq5                                      2/2       Running            0          1h
      onap          onap-msb-iag-6cf5b697f8-m64jz                                     2/2       Running            0          1h
      onap          onap-multicloud-74dd956665-2xwvq                                  2/2       Running            0          1h
      onap          onap-multicloud-ocata-644b48999c-jpqmr                            2/2       Running            0          1h
      onap          onap-multicloud-vio-786d8f8c88-sj7s6                              2/2       Running            0          1h
      onap          onap-multicloud-windriver-99bdd58df-5zmxk                         2/2       Running            0          1h
      onap          onap-nexus-54ddfc9497-qmqqb                                       1/1       Running            1          1h
      onap          onap-pap-7d5b98f968-hx2g9                                         2/2       Running            0          1h
      onap          onap-pdp-0                                                        2/2       Running            0          1h
      onap          onap-pdp-1                                                        2/2       Running            0          1h
      onap          onap-policydb-79488ffb96-vl2n7                                    1/1       Running            0          1h
      onap          onap-portal-app-558d99bcd4-98zvz                                  0/2       Init:0/1           2          23m
      onap          onap-portal-cassandra-57fb4c797f-rkjr9                            1/1       Running            0          1h
      onap          onap-portal-db-787888c89b-46ph4                                   1/1       Running            1          1h
      onap          onap-portal-sdk-7f855d46d4-89fpw                                  2/2       Running            0          1h
      onap          onap-portal-widget-585cf754db-nk4jf                               1/1       Running            0          1h
      onap          onap-portal-zookeeper-696c5f95cb-854cj                            1/1       Running            0          1h
      onap          onap-robot-6d96c57bfb-fn9tn                                       1/1       Running            0          1h
      onap          onap-sdc-be-f59ccf7c9-mztgq                                       2/2       Running            0          1h
      onap          onap-sdc-cs-6746876cc5-nr8bv                                      1/1       Running            0          1h
      onap          onap-sdc-es-b64bfb94d-876dr                                       1/1       Running            0          1h
      onap          onap-sdc-fe-75b8fcb4fd-zskkl                                      2/2       Running            0          1h
      onap          onap-sdc-kb-7f4c88b89c-qx7d2                                      1/1       Running            0          1h
      onap          onap-sdc-onboarding-be-6656f56dc4-xbt22                           2/2       Running            0          1h
      onap          onap-sdc-wfd-7b894c74cc-7q2np                                     1/1       Running            0          1h
      onap          onap-sdnc-0                                                       2/2       Running            0          1h
      onap          onap-sdnc-db-0                                                    2/2       Running            0          1h
      onap          onap-sdnc-dgbuilder-76589b66b6-n64cw                              1/1       Running            0          1h
      onap          onap-sdnc-dmaap-listener-7d69d49655-kf67c                         1/1       Running            0          1h
      onap          onap-sdnc-portal-696f4979c9-sf8kq                                 1/1       Running            12         1h
      onap          onap-sdnc-ueb-listener-74fdb45df7-8pbqr                           1/1       Running            0          1h
      onap          onap-so-db-5974c48944-vxmpr                                       1/1       Running            1          1h
      onap          onap-so-f77449fcd-vk788                                           2/2       Running            0          32m
      onap          onap-uui-66fc98dbd8-stlbk                                         1/1       Running            0          1h
      onap          onap-uui-server-67d6dfbff9-chzp5                                  1/1       Running            1          1h
      onap          onap-vfc-catalog-76f9b55876-mh2p9                                 2/2       Running            10         1h
      onap          onap-vfc-ems-driver-768b8ddfb-t4mhb                               1/1       Running            5          1h
      onap          onap-vfc-generic-vnfm-driver-7c756bdb7-m2djr                      2/2       Running            0          1h
      onap          onap-vfc-huawei-vnfm-driver-5f8588fb6-qf7jz                       2/2       Running            0          1h
      onap          onap-vfc-juju-vnfm-driver-847bf77dbf-xhh97                        2/2       Running            0          1h
      onap          onap-vfc-multivim-proxy-84bff94c6f-8fqk5                          1/1       Running            2          1h
      onap          onap-vfc-nokia-v2vnfm-driver-79895d86f5-fpdtb                     1/1       Running            0          1h
      onap          onap-vfc-nokia-vnfm-driver-6b6d44cbbd-ngnzf                       2/2       Running            0          1h
      onap          onap-vfc-nslcm-64cf4b9d8c-mq9v2                                   2/2       Running            0          1h
      onap          onap-vfc-resmgr-6c46c8c67b-2mhv4                                  2/2       Running            0          1h
      onap          onap-vfc-vnflcm-666b4957c9-zblkb                                  2/2       Running            0          1h
      onap          onap-vfc-vnfmgr-85b66cbb7f-xllxs                                  2/2       Running            0          1h
      onap          onap-vfc-vnfres-bd5c75d-5d847                                     2/2       Running            11         1h
      onap          onap-vfc-workflow-79dbbf8c6c-9g5hh                                1/1       Running            3          1h
      onap          onap-vfc-workflow-engine-676d97fbb6-xlgrl                         1/1       Running            2          1h
      onap          onap-vfc-zte-sdnc-driver-6b95d94875-9gg6m                         1/1       Running            10         1h
      onap          onap-vfc-zte-vnfm-driver-6c9d489c44-nqbg9                         2/2       Running            0          1h
      onap          onap-vid-84f89777d6-rskkr                                         2/2       Running            0          1h
      onap          onap-vid-mariadb-866fc74f8b-ldnpr                                 1/1       Running            0          1h
      onap          onap-vnfsdk-c48b5479-kmj7v                                        1/1       Running            0          1h
      onap          onap-vnfsdk-postgres-6f8b9bf77f-phjwk                             1/1       Running            0          1h
      onap          onap-zookeeper-64df556db-cjsjr                                    1/1       Running            0          1h
      onap          sniro-emulator-7fc8658bcb-hkzpf                                   1/1       Running            0          1h
      

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            • Assignee:
              djtimoney Dan Timoney
              Reporter:
              michaelobrien Michael O'Brien
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: