Uploaded image for project: 'VNF Validation Program'
  1. VNF Validation Program
  2. VVP-124

VVP Imagescanner Pod fails on OOM deploy due to lack of Redis conn error

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Medium
    • Resolution: Done
    • Casablanca Release
    • Dublin Release
    • VVP- Dublin 1

    Description

      Upon successful deployment of Casablanca with all components present except PNDA, the VVP component shows frequent pod restarts on the Imagescanner pod.  Example VVP component pod status after a few days of Casablanca uptime (see highlighted red font):

      onap onap-vvp-vvp-647df775c-kwgzp 1/1 Running 0 2d
      onap onap-vvp-vvp-ci-uwsgi-869547b95d-8lfl5 1/1 Running 0 2d
      onap onap-vvp-vvp-cms-uwsgi-67875bc58d-c2p6v 1/1 Running 0 2d
      onap onap-vvp-vvp-em-uwsgi-cb5946fcd-75gbt 1/1 Running 1 2d
      onap onap-vvp-vvp-ext-haproxy-78cfc9686-vlmhr 1/1 Running 0 2d
      onap onap-vvp-vvp-gitlab-d854f8b88-dp9cd 1/1 Running 0 2d
      onap onap-vvp-vvp-imagescanner-67ddfd664d-25dm5 3/3 Running 156 2d
      onap onap-vvp-vvp-int-haproxy-6c77648b48-mgm9n 1/1 Running 0 2d
      onap onap-vvp-vvp-jenkins-6c8b6fff88-fqtb9 1/1 Running 0 2d
      onap onap-vvp-vvp-postgres-559b9fc8b5-mblhg 1/1 Running 0 2d
      onap onap-vvp-vvp-redis-5d566fdf44-mznns 1/1 Running 0 2d

       

      Log output from the pod shows respectively:

       # kubectl -n onap logs onap-vvp-vvp-imagescanner-67ddfd664d-25dm5 -c imagescanner-worker

      <...snip...>

      [2019-01-03 15:26:50,223: ERROR/MainProcess] consumer: Cannot connect to redis://redis:6379//: Error -2 connecting to redis:6379. Name does not resolve..
      Trying again in 2.00 seconds...

       # kubectl -n onap logs onap-vvp-vvp-imagescanner-67ddfd664d-25dm5 -c notification-worker

      <...snip...>

      [2019-01-03 15:32:37,527: ERROR/MainProcess] consumer: Cannot connect to redis://redis:6379//: Error -2 connecting to redis:6379. Name does not resolve..
      Trying again in 32.00 seconds...

       

      Also, there is a (perhaps unrelated) warning at the top of each of these logs which may need attention:

      /usr/lib/python3.6/site-packages/celery/platforms.py:796: RuntimeWarning: You're running the worker with superuser privileges: this is
      absolutely not recommended!

      Please specify a different user using the --uid option.

      User information: uid=0 euid=0 gid=0 egid=0

      uid=uid, euid=euid, gid=gid, egid=egid,

       

      The related JIRA issue noted (VVP-117) appears to have the same vvp-imagescanner pod restarts shown in that ticket's description text.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. TSC-92 Casablanca RM branch stability before 3.0.1-ONAP tagging - helm deploy/hc before merging

          • High - Severely impaired functionality. Erratic performance and reduced system availability. It may cause major components or features of the system to be unavailable although certain parts of the system remain functional. A workaround may exist but its use is unsatisfactory or at a high time cost (manual intervention required). Must be fixed in any of the upcoming builds and should be included in the current release.
          • Closed

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. VVP-131 Add VVP healthcheck to robot for dublin - even though the pod is design time - need a HC pass on helm deploy testing

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed
          duplicates

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. OOM-1053 Sync docker image images with docker-manifest.csv

          • Medium - Failure of non-critical aspects of the system but results in an inconvenient situation. It causes some undesirable behavior, but the system is still functional. There is a reasonably satisfactory workaround. It is still a valid defect that should be corrected May be fixed after the release or in the next release.
          • Closed
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. VVP-117 Add VVP robot Healthcheck

          • High - Severely impaired functionality. Erratic performance and reduced system availability. It may cause major components or features of the system to be unavailable although certain parts of the system remain functional. A workaround may exist but its use is unsatisfactory or at a high time cost (manual intervention required). Must be fixed in any of the upcoming builds and should be included in the current release.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ss820f steven stark
              JohnL101 John Lotoski
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: