Uploaded image for project: 'ONAP Operations Manager'
  1. ONAP Operations Manager
  2. OOM-834

Periodic nodejs process saturating the EC2 server - not the 10250 port of OOM-806

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not Done
    • Icon: Medium Medium
    • Casablanca Release
    • Beijing Release
    • None

      I have seen the 3 times in the last 4 months
      Currently it is happening inside a fully private VPC - which means the it is not the crypto mining issue that started 2 weeks ago across the internet
      This one
      PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
      105435 root 20 0 1492260 75748 2624 S 1567 0.1 25920:39 nodjs -c /bin/config.json

      Fix is to kill the process
      Note: ONAP pods were not running at this time - it was a clean VM setup with kubernetes for
      Note: so far only on Amazon EC2 instances on EBS

      ubuntu@ip-10-0-0-22:~$ kubectl get pods --all-namespaces
      NAMESPACE     NAME                                   READY     STATUS    RESTARTS   AGE
      kube-system   heapster-76b8cd7b5-4r88h               1/1       Running   0          4d
      kube-system   kube-dns-5d7b4487c9-s4rsg              3/3       Running   0          4d
      kube-system   kubernetes-dashboard-f9577fffd-298r6   1/1       Running   0          4d
      kube-system   monitoring-grafana-997796fcf-wtz7n     1/1       Running   0          4d
      kube-system   monitoring-influxdb-56fdcd96b-2phd2    1/1       Running   0          4d
      kube-system   tiller-deploy-cc96d4f6b-jzqmz          1/1       Running   0          4d
      ubuntu@ip-10-0-0-22:~$ kubectl version
      Client Version: version.Info{Major:"1", Minor:"8", GitVersion:"v1.8.10", GitCommit:"044cd262c40234014f01b40ed7b9d09adbafe9b1", GitTreeState:"clean", BuildDate:"2018-03-19T17:51:28Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}
      Server Version: version.Info{Major:"1", Minor:"8+", GitVersion:"v1.8.10-rancher1", GitCommit:"66aaf7681d4a74778ffae722d1f0f0f42c80a984", GitTreeState:"clean", BuildDate:"2018-03-20T16:02:56Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}
      ubuntu@ip-10-0-0-22:~$ helm version
      Client: &version.Version{SemVer:"v2.6.1", GitCommit:"bbc1f71dc03afc5f00c6ac84b9308f8ecb4f39ac", GitTreeState:"clean"}
      Server: &version.Version{SemVer:"v2.6.1", GitCommit:"bbc1f71dc03afc5f00c6ac84b9308f8ecb4f39ac", GitTreeState:"clean"}
      ubuntu@ip-10-0-0-22:~$ docker version
      WARNING: Error loading config file:/home/ubuntu/.docker/config.json - stat /home/ubuntu/.docker/config.json: permission denied
      Client:
       Version:      17.03.2-ce
       API version:  1.27
       Go version:   go1.7.5
       Git commit:   f5ec1e2
       Built:        Tue Jun 27 03:35:14 2017
       OS/Arch:      linux/amd64
      
      

            Unassigned Unassigned
            michaelobrien michaelobrien
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: