Pod List :-  ubuntu@csranchernode:~/new/oom/kubernetes/robot$ kubectl get pods -n onap | grep vid dev-vid-vid-9f66ff7ff-xsf92 2/2 Running 0 19h dev-vid-vid-galera-config-wfwsm 0/1 Completed 0 19h dev-vid-vid-mariadb-galera-0 1/1 Running 0 19h ubuntu@csranchernode:~/new/oom/kubernetes/robot$ ================================================================================================================================================================================= Pods Description :-  ubuntu@csranchernode:~$ kubectl describe -n onap po dev-vid-vid-9f66ff7ff-xsf92 Name: dev-vid-vid-9f66ff7ff-xsf92 Namespace: onap Node: csnode02/10.0.0.32 Start Time: Tue, 02 Jul 2019 08:49:11 +0000 Labels: app=vid pod-template-hash=592299399 release=dev-vid Annotations: Status: Running IP: 10.42.44.51 Controlled By: ReplicaSet/dev-vid-vid-9f66ff7ff Init Containers: vid-readiness: Container ID: docker://0ebeb88879724a3097545b8f93a78001c3d4916261c90976c5c7a1263a89f91b Image: oomk8s/readiness-check:2.0.1 Image ID: docker-pullable://oomk8s/readiness-check@sha256:3795ad126cd7fd73b55b50d12fc795f950b35ea3371ff72f0a5ae4a79762798b Port: Host Port: Command: /root/job_complete.py Args: --job-name dev-vid-vid-galera-config State: Terminated Reason: Completed Exit Code: 0 Started: Tue, 02 Jul 2019 08:49:20 +0000 Finished: Tue, 02 Jul 2019 08:50:01 +0000 Ready: True Restart Count: 0 Environment: NAMESPACE: onap (v1:metadata.namespace) Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-7qpdf (ro) Containers: vid: Container ID: docker://e1997a412d2d4f5124442a69c403762953cdf96be0215a39b4e019f5f0466265 Image: nexus3.onap.org:10001/onap/vid:3.2.3 Image ID: docker-pullable://nexus3.onap.org:10001/onap/vid@sha256:4c1e644d544e5d2e526ea7c52e4dcb17a3d728afc41e79d59db33419dbc07102 Port: 8443/TCP Host Port: 0/TCP State: Running Started: Tue, 02 Jul 2019 08:50:07 +0000 Ready: True Restart Count: 0 Liveness: tcp-socket :8443 delay=120s timeout=1s period=10s #success=1 #failure=3 Readiness: tcp-socket :8443 delay=10s timeout=1s period=10s #success=1 #failure=3 Environment: ASDC_CLIENT_REST_HOST: sdc-be.onap ASDC_CLIENT_REST_AUTH: Basic dmlkOktwOGJKNFNYc3pNMFdYbGhhazNlSGxjc2UyZ0F3ODR2YW9HR21KdlV5MlU= ASDC_CLIENT_REST_PORT: 8080 VID_AAI_HOST: aai.onap VID_AAI_PORT: 8443 VID_ECOMP_SHARED_CONTEXT_REST_URL: http://portal-app.onap:30225/ONAPPORTAL/context VID_MSO_SERVER_URL: http://so.onap:8080/onap/so/infra VID_MSO_PASS: OBF:1ih71i271vny1yf41ymf1ylz1yf21vn41hzj1icz MSO_DME2_SERVER_URL: http://localhost:8081 MSO_DME2_ENABLED: VID_ECOMP_REDIRECT_URL: https://portal.api.simpledemo.onap.org:30225/ONAPPORTAL/login.htm VID_ECOMP_REST_URL: https://portal-app:8443/ONAPPORTAL/auxapi VID_ROLE_ACCESS_CENTRALIZED: remote VID_CONTACT_US_LINK: https://todo_contact_us_link.com VID_UEB_URL_LIST: message-router.onap VID_MYSQL_HOST: vid-galera VID_MYSQL_PORT: 3306 VID_MYSQL_DBNAME: vid_openecomp_epsdk VID_MYSQL_USER: vidadmin VID_MYSQL_PASS: Kp8bJ4SXszM0WXlhak3eHlcse2gAw84vaoGGmJvUy2U VID_MYSQL_MAXCONNECTIONS: 5 Mounts: /etc/localtime from localtime (ro) /tmp/logback.xml from vid-logback (rw) /var/log/onap from vid-logs (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-7qpdf (ro) filebeat-onap: Container ID: docker://5f1440047d60fb1a8743f581edc2f017e31e67728d3c282a98447d561fe61f37 Image: docker.elastic.co/beats/filebeat:5.5.0 Image ID: docker-pullable://docker.elastic.co/beats/filebeat@sha256:fe7602b641ed8ee288f067f7b31ebde14644c4722d9f7960f176d621097a5942 Port: Host Port: State: Running Started: Tue, 02 Jul 2019 08:50:10 +0000 Ready: True Restart Count: 0 Environment: Mounts: /usr/share/filebeat/data from vid-data-filebeat (rw) /usr/share/filebeat/filebeat.yml from filebeat-conf (rw) /var/log/onap from vid-logs (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-7qpdf (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: localtime: Type: HostPath (bare host directory volume) Path: /etc/localtime HostPathType: filebeat-conf: Type: ConfigMap (a volume populated by a ConfigMap) Name: dev-vid-vid-filebeat-configmap Optional: false vid-logs: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: vid-data-filebeat: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: vid-logback: Type: ConfigMap (a volume populated by a ConfigMap) Name: dev-vid-vid-log-configmap Optional: false default-token-7qpdf: Type: Secret (a volume populated by a Secret) SecretName: default-token-7qpdf Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: ================================================================================================================================================================================= ubuntu@csranchernode:~$ kubectl describe -n onap po dev-vid-vid-galera-config-wfwsm Name: dev-vid-vid-galera-config-wfwsm Namespace: onap Node: csnode05/10.0.0.35 Start Time: Tue, 02 Jul 2019 08:49:08 +0000 Labels: app=vid-job controller-uid=56a06a3d-9ca6-11e9-bd26-02a4383f8771 job-name=dev-vid-vid-galera-config release=dev-vid Annotations: Status: Succeeded IP: 10.42.16.83 Controlled By: Job/dev-vid-vid-galera-config Init Containers: vid-readiness: Container ID: docker://b7e2ae2b3cb59d791c293d096b6d91588ca9b5b3febd5065825cab8304e8a80f Image: oomk8s/readiness-check:2.0.1 Image ID: docker-pullable://oomk8s/readiness-check@sha256:3795ad126cd7fd73b55b50d12fc795f950b35ea3371ff72f0a5ae4a79762798b Port: Host Port: Command: /root/ready.py --container-name dev-vid-vid-mariadb-galera-0 State: Terminated Reason: Completed Exit Code: 0 Started: Tue, 02 Jul 2019 08:49:17 +0000 Finished: Tue, 02 Jul 2019 08:49:47 +0000 Ready: True Restart Count: 0 Environment: NAMESPACE: onap (v1:metadata.namespace) Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-7qpdf (ro) Containers: vid-job: Container ID: docker://104181c4744e0f6e4debaf399307d536d284f8950ffd8c665da6c2a4ed070b19 Image: library/mariadb:10 Image ID: docker-pullable://mariadb@sha256:29e6b7cff37f102aea741de2005f5b007031a003223e010c9b78a34f91ec069d Port: Host Port: Command: /bin/sh Args: -x /dbcmd-config/db_cmd.sh State: Terminated Reason: Completed Exit Code: 0 Started: Tue, 02 Jul 2019 08:49:54 +0000 Finished: Tue, 02 Jul 2019 08:49:55 +0000 Ready: False Restart Count: 0 Environment: MYSQL_PASSWORD: Kp8bJ4SXszM0WXlhak3eHlcse2gAw84vaoGGmJvUy2U MYSQL_HOST: vid-galera MYSQL_USER: vidadmin MYSQL_PORT: 3306 Mounts: /db-config/vid-pre-init.sql from dev-vid-vid-config (rw) /dbcmd-config/db_cmd.sh from dev-vid-vid-config (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-7qpdf (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: dev-vid-vid-config: Type: ConfigMap (a volume populated by a ConfigMap) Name: dev-vid-vid Optional: false default-token-7qpdf: Type: Secret (a volume populated by a Secret) SecretName: default-token-7qpdf Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: ================================================================================================================================================================================= ubuntu@csranchernode:~$ kubectl describe -n onap po dev-vid-vid-mariadb-galera-0 Name: dev-vid-vid-mariadb-galera-0 Namespace: onap Node: csnode01/ Start Time: Tue, 02 Jul 2019 08:49:44 +0000 Labels: app=dev-vid-vid-mariadb-galera controller-revision-hash=dev-vid-vid-mariadb-galera-84d5d548b7 release=dev-vid statefulset.kubernetes.io/pod-name=dev-vid-vid-mariadb-galera-0 Annotations: pod.alpha.kubernetes.io/initialized=true Status: Running IP: 10.42.49.251 Controlled By: StatefulSet/dev-vid-vid-mariadb-galera Containers: dev-vid-vid-mariadb-galera: Container ID: docker://82c88b940fcba15f61f86a32f1357d766747b8062c87754ef1e6156a39cf7074 Image: nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos:v002 Image ID: docker-pullable://nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos@sha256:fbcb842f30065ae94532cb1af9bb03cc6e2acaaf896d87d0ec38da7dd09a3dde Ports: 3306/TCP, 4444/TCP, 4567/TCP, 4568/TCP Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP State: Running Started: Tue, 02 Jul 2019 08:49:53 +0000 Ready: True Restart Count: 0 Readiness: exec [/usr/share/container-scripts/mysql/readiness-probe.sh] delay=15s timeout=1s period=10s #success=1 #failure=3 Environment: POD_NAMESPACE: onap (v1:metadata.namespace) MYSQL_USER: vidadmin MYSQL_PASSWORD: Optional: false MYSQL_DATABASE: vid_openecomp_epsdk MYSQL_ROOT_PASSWORD: Optional: false Mounts: /etc/config from config (rw) /etc/localtime from localtime (ro) /var/run/secrets/kubernetes.io/serviceaccount from default-token-7qpdf (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: config: Type: ConfigMap (a volume populated by a ConfigMap) Name: dev-vid-vid-mariadb-galera-externalconfig Optional: false localtime: Type: HostPath (bare host directory volume) Path: /etc/localtime HostPathType: default-token-7qpdf: Type: Secret (a volume populated by a Secret) SecretName: default-token-7qpdf Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: ================================================================================================================================================================================= Pod Logs :-  ubuntu@csranchernode:~$ kubectl logs -n onap dev-vid-vid-mariadb-galera-0 Galera: Finding peers + CONTAINER_SCRIPTS_DIR=/usr/share/container-scripts/mysql + EXTRA_DEFAULTS_FILE=/etc/my.cnf.d/galera.cnf + '[' -z onap ']' + echo 'Galera: Finding peers' ++ hostname -f ++ cut -d. -f2 Using service name: vid-galera + K8S_SVC_NAME=vid-galera + echo 'Using service name: vid-galera' + cp /usr/share/container-scripts/mysql/galera.cnf /etc/my.cnf.d/galera.cnf + /usr/bin/peer-finder -on-start=/usr/share/container-scripts/mysql/configure-galera.sh -service=vid-galera 2019/07/02 08:49:54 lookup vid-galera on 10.43.0.10:53: no such host 2019/07/02 08:49:55 Peer list updated was [] now [dev-vid-vid-mariadb-galera-0.vid-galera.onap.svc.cluster.local] 2019/07/02 08:49:55 execing: /usr/share/container-scripts/mysql/configure-galera.sh with stdin: dev-vid-vid-mariadb-galera-0.vid-galera.onap.svc.cluster.local 2019/07/02 08:49:55 2019/07/02 08:49:56 Peer finder exiting Configure first time mysql + '[' '!' -d /var/lib/mysql/mysql ']' + echo 'Configure first time mysql' + /usr/share/container-scripts/mysql/configure-mysql.sh + echo 'Running mysql_install_db ...' + mysql_install_db --datadir=/var/lib/mysql Running mysql_install_db ... Installing MariaDB/MySQL system tables in '/var/lib/mysql' ... 2019-07-02 8:49:56 140056393054464 [Note] /usr/sbin/mysqld (mysqld 10.1.24-MariaDB) starting as process 50 ... 2019-07-02 8:49:56 140056393054464 [Note] WSREP: Read nil XID from storage engines, skipping position init 2019-07-02 8:49:56 140056393054464 [Note] WSREP: wsrep_load(): loading provider library 'none' 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB. 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: The InnoDB memory heap is disabled 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: Using Linux native AIO 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: Using SSE crc32 instructions 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: Completed initialization of buffer pool 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: The first specified data file ./ibdata1 did not exist: a new database to be created! 2019-07-02 8:49:56 140056393054464 [Note] InnoDB: Setting file ./ibdata1 size to 12 MB 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Setting log file ./ib_logfile101 size to 48 MB 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Setting log file ./ib_logfile1 size to 48 MB 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 2019-07-02 8:49:57 140056393054464 [Warning] InnoDB: New log files created, LSN=45883 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Doublewrite buffer not found: creating new 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Doublewrite buffer created 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: 128 rollback segment(s) are active. 2019-07-02 8:49:57 140056393054464 [Warning] InnoDB: Creating foreign key constraint system tables. 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Foreign key constraint system tables created 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Creating tablespace and datafile system tables. 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Tablespace and datafile system tables created. 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Waiting for purge to start 2019-07-02 8:49:57 140056393054464 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.36-82.0 started; log sequence number 0 2019-07-02 8:49:57 140055607768832 [Note] InnoDB: Dumping buffer pool(s) not yet started OK Filling help tables... 2019-07-02 8:50:01 140310086486272 [Note] /usr/sbin/mysqld (mysqld 10.1.24-MariaDB) starting as process 85 ... 2019-07-02 8:50:01 140310086486272 [Note] WSREP: Read nil XID from storage engines, skipping position init 2019-07-02 8:50:01 140310086486272 [Note] WSREP: wsrep_load(): loading provider library 'none' 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB. 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: The InnoDB memory heap is disabled 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Using Linux native AIO 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Using SSE crc32 instructions 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Completed initialization of buffer pool 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Highest supported file format is Barracuda. 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: 128 rollback segment(s) are active. 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Waiting for purge to start 2019-07-02 8:50:01 140310086486272 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.36-82.0 started; log sequence number 1616799 2019-07-02 8:50:01 140309304440576 [Note] InnoDB: Dumping buffer pool(s) not yet started OK Creating OpenGIS required SP-s... 2019-07-02 8:50:05 139683789453568 [Note] /usr/sbin/mysqld (mysqld 10.1.24-MariaDB) starting as process 115 ... 2019-07-02 8:50:05 139683789453568 [Note] WSREP: Read nil XID from storage engines, skipping position init 2019-07-02 8:50:05 139683789453568 [Note] WSREP: wsrep_load(): loading provider library 'none' 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB. 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: The InnoDB memory heap is disabled 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Using Linux native AIO 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Using SSE crc32 instructions 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Completed initialization of buffer pool 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Highest supported file format is Barracuda. 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: 128 rollback segment(s) are active. 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Waiting for purge to start 2019-07-02 8:50:05 139683789453568 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.36-82.0 started; log sequence number 1616809 2019-07-02 8:50:05 139683010967296 [Note] InnoDB: Dumping buffer pool(s) not yet started OK To start mysqld at boot time you have to copy support-files/mysql.server to the right place for your system PLEASE REMEMBER TO SET A PASSWORD FOR THE MariaDB root USER ! To do so, start the server, then issue the following commands: '/usr/bin/mysqladmin' -u root password 'new-password' '/usr/bin/mysqladmin' -u root -h dev-vid-vid-mariadb-galera-0 password 'new-password' Alternatively you can run: '/usr/bin/mysql_secure_installation' which will also give you the option of removing the test databases and anonymous user created by default. This is strongly recommended for production servers. See the MariaDB Knowledgebase at http://mariadb.com/kb or the MySQL manual for more instructions. You can start the MariaDB daemon with: cd '/usr' ; /usr/bin/mysqld_safe --datadir='/var/lib/mysql' You can test the MariaDB daemon with mysql-test-run.pl cd '/usr/mysql-test' ; perl mysql-test-run.pl Please report any problems at http://mariadb.org/jira The latest information about MariaDB is available at http://mariadb.org/. You can find additional information about the MySQL part at: http://dev.mysql.com Consider joining MariaDB's strong and vibrant community: https://mariadb.org/get-involved/ + echo 'Finished mysql_install_db' Finished mysql_install_db + pid=148 + mysql=(mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock) + for i in '{30..0}' + mysqld --skip-networking --socket=/var/lib/mysql/mysql-init.sock --wsrep_on=OFF + echo 'SELECT 1' + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock + echo 'MySQL init process in progress...' + sleep 1 MySQL init process in progress... 2019-07-02 8:50:09 139805549279488 [Note] mysqld (mysqld 10.1.24-MariaDB) starting as process 148 ... 2019-07-02 8:50:09 139805549279488 [Warning] You need to use --log-bin to make --binlog-format work. 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB. 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: The InnoDB memory heap is disabled 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: Using Linux native AIO 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: Using SSE crc32 instructions 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2019-07-02 8:50:09 139805549279488 [Note] InnoDB: Completed initialization of buffer pool 2019-07-02 8:50:10 139805549279488 [Note] InnoDB: Highest supported file format is Barracuda. 2019-07-02 8:50:10 139805549279488 [Note] InnoDB: 128 rollback segment(s) are active. 2019-07-02 8:50:10 139805549279488 [Note] InnoDB: Waiting for purge to start 2019-07-02 8:50:10 139805549279488 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.36-82.0 started; log sequence number 1616819 2019-07-02 8:50:10 139804767418112 [Note] InnoDB: Dumping buffer pool(s) not yet started 2019-07-02 8:50:10 139805549279488 [Note] Plugin 'FEEDBACK' is disabled. 2019-07-02 8:50:10 139805549279488 [Note] mysqld: ready for connections. Version: '10.1.24-MariaDB' socket: '/var/lib/mysql/mysql-init.sock' port: 0 MariaDB Server + for i in '{30..0}' + echo 'SELECT 1' + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock + break + '[' 29 = 0 ']' + '[' -z '' ']' + mysql_tzinfo_to_sql /usr/share/zoneinfo + sed 's/Local time zone must be set--see zic manual page/FCTY/' + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock mysql + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock + '[' '!' -z secretpassword ']' + mysql+=(-p"${MYSQL_ROOT_PASSWORD}") + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock -psecretpassword + '[' vid_openecomp_epsdk ']' + echo 'CREATE DATABASE IF NOT EXISTS `vid_openecomp_epsdk` ;' + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock -psecretpassword + mysql+=("$MYSQL_DATABASE") + '[' vidadmin -a Kp8bJ4SXszM0WXlhak3eHlcse2gAw84vaoGGmJvUy2U ']' + echo 'CREATE USER '\''vidadmin'\''@'\''%'\'' IDENTIFIED BY '\''Kp8bJ4SXszM0WXlhak3eHlcse2gAw84vaoGGmJvUy2U'\'' ;' + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock -psecretpassword vid_openecomp_epsdk + '[' vid_openecomp_epsdk ']' + echo 'GRANT ALL ON `vid_openecomp_epsdk`.* TO '\''vidadmin'\''@'\''%'\'' ;' + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock -psecretpassword vid_openecomp_epsdk + echo 'FLUSH PRIVILEGES ;' + mysql --protocol=socket -uroot -hlocalhost --socket=/var/lib/mysql/mysql-init.sock -psecretpassword vid_openecomp_epsdk + kill -s TERM 148 + wait 148 2019-07-02 8:50:12 139805548428032 [Note] mysqld: Normal shutdown 2019-07-02 8:50:12 139805548428032 [Note] Event Scheduler: Purging the queue. 0 events 2019-07-02 8:50:12 139804750632704 [Note] InnoDB: FTS optimize thread exiting. 2019-07-02 8:50:12 139805548428032 [Note] InnoDB: Starting shutdown... 2019-07-02 8:50:13 139805548428032 [Note] InnoDB: Waiting for page_cleaner to finish flushing of buffer pool 2019-07-02 8:50:14 139805548428032 [Note] InnoDB: Shutdown completed; log sequence number 1616829 2019-07-02 8:50:14 139805548428032 [Note] mysqld: Shutdown complete MySQL init process done. Ready for start up. + echo + echo 'MySQL init process done. Ready for start up.' + echo + exec mysqld 2019-07-02 8:50:15 139942291069184 [Note] mysqld (mysqld 10.1.24-MariaDB) starting as process 1 ... 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Read nil XID from storage engines, skipping position init 2019-07-02 8:50:15 139942291069184 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' 2019-07-02 8:50:15 139942291069184 [Note] WSREP: wsrep_load(): Galera 25.3.20(r3703) by Codership Oy loaded successfully. 2019-07-02 8:50:15 139942291069184 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-07-02 8:50:15 139942291069184 [Warning] WSREP: Could not open state file for reading: '/var/lib/mysql//grastate.dat' 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootsrap: 1 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = dev-vid-vid-mariadb-galera-0.vid-galera.onap.svc.cluster.local; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc. 2019-07-02 8:50:15 139942291069184 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0) -> new(00000000-0000-0000-0000-000000000000:-1) 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 2019-07-02 8:50:15 139942291069184 [Note] WSREP: wsrep_sst_grab() 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Start replication 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 2019-07-02 8:50:15 139942291069184 [Note] WSREP: protonet asio version 0 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Using CRC-32C for message checksums. 2019-07-02 8:50:15 139942291069184 [Note] WSREP: backend: asio 2019-07-02 8:50:15 139942291069184 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-07-02 8:50:15 139942291069184 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2019-07-02 8:50:15 139942291069184 [Note] WSREP: restore pc from disk failed 2019-07-02 8:50:15 139942291069184 [Note] WSREP: GMCast version 0 2019-07-02 8:50:15 139942291069184 [Note] WSREP: (68f556b5, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2019-07-02 8:50:15 139942291069184 [Note] WSREP: (68f556b5, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2019-07-02 8:50:15 139942291069184 [Note] WSREP: EVS version 0 2019-07-02 8:50:15 139942291069184 [Note] WSREP: gcomm: connecting to group 'vid-galera', peer '' 2019-07-02 8:50:15 139942291069184 [Note] WSREP: start_prim is enabled, turn off pc_recovery 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Node 68f556b5 state prim 2019-07-02 8:50:15 139942291069184 [Note] WSREP: view(view_id(PRIM,68f556b5,1) memb { 68f556b5,0 } joined { } left { } partitioned { }) 2019-07-02 8:50:15 139942291069184 [Note] WSREP: save pc into disk 2019-07-02 8:50:15 139942291069184 [Note] WSREP: gcomm: connected 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Opened channel 'vid-galera' 2019-07-02 8:50:15 139942291069184 [Note] WSREP: Waiting for SST to complete. 2019-07-02 8:50:15 139941967292160 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2019-07-02 8:50:15 139941967292160 [Note] WSREP: Starting new group from scratch: 68f5b832-9ca6-11e9-bb2a-4f65d0314559 2019-07-02 8:50:15 139941967292160 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 68f5c9a7-9ca6-11e9-855f-06f91446ddce 2019-07-02 8:50:15 139941967292160 [Note] WSREP: STATE EXCHANGE: sent state msg: 68f5c9a7-9ca6-11e9-855f-06f91446ddce 2019-07-02 8:50:15 139941967292160 [Note] WSREP: STATE EXCHANGE: got state msg: 68f5c9a7-9ca6-11e9-855f-06f91446ddce from 0 (dev-vid-vid-mariadb-galera-0) 2019-07-02 8:50:15 139941967292160 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 0, members = 1/1 (joined/total), act_id = 0, last_appl. = -1, protocols = 0/7/3 (gcs/repl/appl), group UUID = 68f5b832-9ca6-11e9-bb2a-4f65d0314559 2019-07-02 8:50:15 139941967292160 [Note] WSREP: Flow-control interval: [16, 16] 2019-07-02 8:50:15 139941967292160 [Note] WSREP: Restored state OPEN -> JOINED (0) 2019-07-02 8:50:15 139941967292160 [Note] WSREP: Member 0.0 (dev-vid-vid-mariadb-galera-0) synced with group. 2019-07-02 8:50:15 139941967292160 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0) 2019-07-02 8:50:15 139942290750208 [Note] WSREP: New cluster view: global state: 68f5b832-9ca6-11e9-bb2a-4f65d0314559:0, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3 2019-07-02 8:50:15 139942291069184 [Note] WSREP: SST complete, seqno: 0 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB. 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: The InnoDB memory heap is disabled 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Using Linux native AIO 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Using SSE crc32 instructions 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Completed initialization of buffer pool 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Highest supported file format is Barracuda. 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: 128 rollback segment(s) are active. 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Waiting for purge to start 2019-07-02 8:50:15 139942291069184 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.36-82.0 started; log sequence number 1616829 2019-07-02 8:50:15 139941283624704 [Note] InnoDB: Dumping buffer pool(s) not yet started 2019-07-02 8:50:15 139942291069184 [Note] Plugin 'FEEDBACK' is disabled. 2019-07-02 8:50:15 139942291069184 [Note] Server socket created on IP: '0.0.0.0'. 2019-07-02 8:50:15 139942290750208 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-02 8:50:15 139942290750208 [Note] WSREP: REPL Protocols: 7 (3, 2) 2019-07-02 8:50:15 139942290750208 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3 2019-07-02 8:50:15 139942291069184 [Note] mysqld: ready for connections. Version: '10.1.24-MariaDB' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server 2019-07-02 8:50:15 139942025598720 [Note] WSREP: Service thread queue flushed. 2019-07-02 8:50:15 139942290750208 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0) -> new(68f5b832-9ca6-11e9-bb2a-4f65d0314559:0) 2019-07-02 8:50:15 139942290750208 [Note] WSREP: Synchronized with group, ready for connections 2019-07-02 8:50:15 139942290750208 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-02 8:50:31 139942289603328 [Warning] IP address '10.42.16.83' could not be resolved: Name or service not known 2019-07-02 8:51:03 139942211160832 [Warning] IP address '10.42.44.51' could not be resolved: Name or service not known 2019-07-02 8:51:03 139942170688256 [Warning] IP address '10.42.44.51' could not be resolved: Name or service not known 2019-07-02 8:51:03 139942289603328 [Warning] IP address '10.42.44.51' could not be resolved: Name or service not known ================================================================================================================================================================================= ubuntu@csranchernode:~$ kubectl logs -n onap dev-vid-vid-galera-config-wfwsm + echo Going to run mysql -uvidadmin -pKp8bJ4SXszM0WXlhak3eHlcse2gAw84vaoGGmJvUy2U -hvid-galera -P3306 ... + mysql -uvidadmin -pKp8bJ4SXszM0WXlhak3eHlcse2gAw84vaoGGmJvUy2U -hvid-galera -P3306 Going to run mysql -uvidadmin -pKp8bJ4SXszM0WXlhak3eHlcse2gAw84vaoGGmJvUy2U -hvid-galera -P3306 ... INFO: Database initialized successfully + [ 0 -ne 0 ] + echo INFO: Database initialized successfully ================================================================================================================================================================================= ubuntu@csranchernode:~$ kubectl logs -n onap dev-vid-vid-9f66ff7ff-xsf92 -c vid-readiness 2019-07-02 08:49:21,204 - INFO - Checking if dev-vid-vid-galera-config is complete 2019-07-02 08:49:21,236 - INFO - dev-vid-vid-galera-config has not succeeded yet 2019-07-02 08:49:26,240 - INFO - Checking if dev-vid-vid-galera-config is complete 2019-07-02 08:49:26,254 - INFO - dev-vid-vid-galera-config has not succeeded yet 2019-07-02 08:49:31,256 - INFO - Checking if dev-vid-vid-galera-config is complete 2019-07-02 08:49:31,269 - INFO - dev-vid-vid-galera-config has not succeeded yet 2019-07-02 08:49:36,271 - INFO - Checking if dev-vid-vid-galera-config is complete 2019-07-02 08:49:36,282 - INFO - dev-vid-vid-galera-config has not succeeded yet 2019-07-02 08:49:41,285 - INFO - Checking if dev-vid-vid-galera-config is complete 2019-07-02 08:49:41,302 - INFO - dev-vid-vid-galera-config has not succeeded yet 2019-07-02 08:49:46,308 - INFO - Checking if dev-vid-vid-galera-config is complete 2019-07-02 08:49:46,322 - INFO - dev-vid-vid-galera-config has not succeeded yet 2019-07-02 08:49:51,326 - INFO - Checking if dev-vid-vid-galera-config is complete 2019-07-02 08:49:51,343 - INFO - dev-vid-vid-galera-config has not succeeded yet 2019-07-02 08:49:56,348 - INFO - Checking if dev-vid-vid-galera-config is complete 2019-07-02 08:49:56,361 - INFO - dev-vid-vid-galera-config has not succeeded yet 2019-07-02 08:50:01,364 - INFO - Checking if dev-vid-vid-galera-config is complete ================================================================================================================================================================================= Please guide me regarding this issue.