Uploaded image for project: 'Logging analytics'
  1. Logging analytics
  2. LOG-487

LOG Pipeline Integrity: Docker to Filebeat to Logstash to ElasticSearch to Kibana

    XMLWordPrintable

Details

    • Epic
    • Status: Closed
    • Highest
    • Resolution: Won't Do
    • None
    • Frankfurt Release
    • LOG Pipeline Integrity: Docker to Filebeat to Logstash to ElasticSearch to Kibana

    Description

      validate all pipelines - refer to the red sidecars in the deployment diagram attached
      docker to filebeat
      filebeat to logstash
      elasticsearch to kibana

      prioritize
      aai, sdc, so, sdnc, appc

      Example aai-traversal looks wrong
      <property name="logDirectory" value="${AJSC_HOME}/logs" />

      validate all

      22:41:20 pending containers=3
22:41:20 onap          onap-aai-champ-68ff644d85-mnf79                  0/1       Running            0          2h
22:41:20 onap          onap-clamp-7d69d4cdd7-vlkkk                      1/2       CrashLoopBackOff   31         2h
22:41:20 onap          onap-sdc-be-8447b4d544-7tn5w                     1/2       Running            0          2h
22:41:20 check filebeat 2/2 count for ELK stack logging consumption
22:41:20 onap          dep-config-binding-service-6c95dd486-d45nn       2/2       Running            0          1h
22:41:20 onap          dep-dcae-tca-analytics-7fc76c48d6-c4gz8          2/2       Running            0          1h
22:41:20 onap          dep-dcae-ves-collector-644bcd89d-s729b           2/2       Running            0          1h
22:41:20 onap          dep-deployment-handler-775bf9ff4c-6hhpr          2/2       Running            0          1h
22:41:20 onap          dep-policy-handler-7757f67545-8fml7              2/2       Running            0          1h
22:41:20 onap          onap-aaf-sms-vault-0                             2/2       Running            1          2h
22:41:20 onap          onap-aai-babel-7dcc9f857c-nnkhn                  2/2       Running            0          2h
22:41:20 onap          onap-aai-gizmo-669559fcf4-znbtp                  2/2       Running            0          2h
22:41:20 onap          onap-aai-modelloader-688b8f8cf-rdldf             2/2       Running            0          2h
22:41:20 onap          onap-aai-resources-7c8b5bdb94-fddxk              2/2       Running            0          2h
22:41:20 onap          onap-aai-search-data-7dddfc56cc-5zghs            2/2       Running            0          2h
22:41:20 onap          onap-aai-sparky-be-7b59459db8-nns4j              2/2       Running            0          2h
22:41:20 onap          onap-aai-traversal-7485bb9bc5-gt7nd              2/2       Running            0          2h
22:41:20 onap          onap-appc-0                                      2/2       Running            0          2h
22:41:20 onap          onap-appc-db-0                                   2/2       Running            0          2h
22:41:20 onap          onap-esr-8698b9645-rl2lc                         2/2       Running            0          2h
22:41:20 onap          onap-msb-discovery-5f985878cd-4d2pk              2/2       Running            0          2h
22:41:20 onap          onap-msb-eag-8568c8cfd5-gh6ng                    2/2       Running            0          2h
22:41:20 onap          onap-msb-iag-56dd5ffd4b-98bbw                    2/2       Running            0          2h
22:41:20 onap          onap-multicloud-6dc6c6b7c7-ffqk6                 2/2       Running            0          2h
22:41:20 onap          onap-multicloud-ocata-69c5b7c79-wvv6p            2/2       Running            0          2h
22:41:20 onap          onap-multicloud-vio-787c5bd7c6-ht5z4             2/2       Running            0          2h
22:41:20 onap          onap-multicloud-windriver-7587dd969c-8twt8       2/2       Running            0          2h
22:41:20 onap          onap-pap-f4cd77b59-lpx88                         2/2       Running            0          2h
22:41:20 onap          onap-pdp-0                                       2/2       Running            0          2h
22:41:20 onap          onap-portal-app-8486dc7ff8-68gfb                 2/2       Running            0          2h
22:41:20 onap          onap-portal-sdk-77cd558c98-txkfn                 2/2       Running            0          2h
22:41:20 onap          onap-sdc-fe-6967b675bf-szrlv                     2/2       Running            0          2h
22:41:20 onap          onap-sdc-onboarding-be-6cb8cbcb95-dm4q9          2/2       Running            0          2h
22:41:20 onap          onap-sdnc-0                                      2/2       Running            0          2h
22:41:20 onap          onap-sdnc-db-0                                   2/2       Running            0          2h
22:41:20 onap          onap-so-57d4b4f65c-lgqxx                         2/2       Running            0          2h
22:41:20 onap          onap-vfc-catalog-8546df5cb4-qz4dr                2/2       Running            0          2h
22:41:20 onap          onap-vfc-generic-vnfm-driver-6d4bbcc95-kdw2f     2/2       Running            0          2h
22:41:20 onap          onap-vfc-huawei-vnfm-driver-6c7c679854-7c58p     2/2       Running            0          2h
22:41:20 onap          onap-vfc-juju-vnfm-driver-6f968ff56c-js9j2       2/2       Running            0          2h
22:41:20 onap          onap-vfc-nokia-vnfm-driver-56c94fd554-5hzqr      2/2       Running            0          2h
22:41:20 onap          onap-vfc-nslcm-8485cfd5cf-pbsnj                  2/2       Running            0          2h
22:41:20 onap          onap-vfc-resmgr-5996c566bd-brnv2                 2/2       Running            0          2h
22:41:20 onap          onap-vfc-vnflcm-55c6b98669-z5xqq                 2/2       Running            7          2h
22:41:20 onap          onap-vfc-vnfmgr-85bcb7df7-7pgxb                  2/2       Running            0          2h
22:41:20 onap          onap-vfc-vnfres-7b4f456764-cm222                 2/2       Running            0          2h
22:41:20 onap          onap-vfc-zte-vnfm-driver-d949cf65b-647dg         2/2       Running            0          2h
22:41:20 onap          onap-vid-5876f9b58d-vg8xr                        2/2       Running            0          2h

      Attachments

        Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. LOG-877 S3P: Logging streaming/format alignment for dublin - China Telecom, Deutsche Telekom, Vodafone

          • Highest - Catastrophic defect that causes total failure of the software or unrecoverable data loss with no available workaround. Complete shut-down of the process, nothing can proceed further. Blocks testing of the product / feature. Must be fixed in the next build.
          • Closed

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LOG-178 Log Specification Alignment - each onap component

          • High - Severely impaired functionality. Erratic performance and reduced system availability. It may cause major components or features of the system to be unavailable although certain parts of the system remain functional. A workaround may exist but its use is unsatisfactory or at a high time cost (manual intervention required). Must be fixed in any of the upcoming builds and should be included in the current release.
          • Closed

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LOG-707 Logging El-Alto (moved from) Dublin Scope

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed
          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. LOG-992 RKE 0.16 / Docker 18.06 for ONAP installation - migrate from Rancher for Dublin - script support

          • Highest - Catastrophic defect that causes total failure of the software or unrecoverable data loss with no available workaround. Complete shut-down of the process, nothing can proceed further. Blocks testing of the product / feature. Must be fixed in the next build.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. LOG-880 NetworkDiscovery Context builder does not log any information

          • High - Severely impaired functionality. Erratic performance and reduced system availability. It may cause major components or features of the system to be unavailable although certain parts of the system remain functional. A workaround may exist but its use is unsatisfactory or at a high time cost (manual intervention required). Must be fixed in any of the upcoming builds and should be included in the current release.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. CLAMP-199 filebeat data volumeMount typo datag should be data - filebeat will add a second data dir

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed

          Sub-task - The sub-task of the issue DMAAP-853 [DR] Implement OOM Logging solution

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed

          Sub-task - The sub-task of the issue LOG-137 Logging RI: Code OOM kubernetes template/values yamls for RI microservice and filebeat container

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. LOG-842 multicloud log messages cannot be found from logging kibana

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. LOG-852 POMBA: Some pods do not ship with filebeat

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. LOG-986 Some POMBA pods are not shipping logs to central logging ELK stack

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SO-1110 Re-add Filebeat sidecars to SO after 2-9 container refactor

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed
          relates to

          Task - A task that needs to be done. AAI-797 Introduction of Chameleon and Gallifrey to ONAP

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. SDC-1530 Add Logging support for WF

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. LOG-876 S3P: Logging for Core Service/VNF state and transition model - Deutsche Telekom and Vodafone

          • High - Severely impaired functionality. Erratic performance and reduced system availability. It may cause major components or features of the system to be unavailable although certain parts of the system remain functional. A workaround may exist but its use is unsatisfactory or at a high time cost (manual intervention required). Must be fixed in any of the upcoming builds and should be included in the current release.
          • Closed

          Task - A task that needs to be done. LOG-1039 Add filebeat sidecars to SO

          • High - Severely impaired functionality. Erratic performance and reduced system availability. It may cause major components or features of the system to be unavailable although certain parts of the system remain functional. A workaround may exist but its use is unsatisfactory or at a high time cost (manual intervention required). Must be fixed in any of the upcoming builds and should be included in the current release.
          • Closed

          Sub-task - The sub-task of the issue AAI-1810 Add option to enable logging for haproxy docker

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              pau2882 Prudence Au
              michaelobrien Michael O'Brien
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: