-
Bug
-
Resolution: Done
-
High
-
Frankfurt Release
-
None
ONAP version - master OOM (18.03.2020)
ubuntu@onap-5428-rke-node:~/oom/kubernetes/robot$ git log
commit c854b484ebbd5e0c1be1e6a032a79beeb4cab6ff (HEAD, master)
During model distribution we see an distribution error comming from SDNC
As has been checked in dev-sdnc-ueb-listener in logs from this container we see:
kubectl logs dev-sdnc-ueb-listener-7c5f4b4858-mggzh -n onap Mar 18, 2020 3:58:50 PM org.apache.tomcat.jdbc.pool.ConnectionPool init SEVERE: Unable to create initial connections of pool. java.sql.SQLInvalidAuthorizationSpecException: Could not connect: Access denied for user 'sdnctl'@'10.42.7.67' (using password: YES) at org.mariadb.jdbc.internal.util.exceptions.ExceptionMapper.get(ExceptionMapper.java:154) at org.mariadb.jdbc.internal.util.exceptions.ExceptionMapper.getException(ExceptionMapper.java:118) at org.mariadb.jdbc.internal.util.exceptions.ExceptionMapper.throwException(ExceptionMapper.java:92) at org.mariadb.jdbc.Driver.connect(Driver.java:102) at org.apache.tomcat.jdbc.pool.PooledConnection.connectUsingDriver(PooledConnection.java:310) at org.apache.tomcat.jdbc.pool.PooledConnection.connect(PooledConnection.java:203) at org.apache.tomcat.jdbc.pool.ConnectionPool.createConnection(ConnectionPool.java:735) at org.apache.tomcat.jdbc.pool.ConnectionPool.borrowConnection(ConnectionPool.java:667) at org.apache.tomcat.jdbc.pool.ConnectionPool.init(ConnectionPool.java:482) at org.apache.tomcat.jdbc.pool.ConnectionPool.<init>(ConnectionPool.java:154) at org.apache.tomcat.jdbc.pool.DataSourceProxy.pCreatePool(DataSourceProxy.java:118) at org.apache.tomcat.jdbc.pool.DataSourceProxy.createPool(DataSourceProxy.java:107) at org.apache.tomcat.jdbc.pool.DataSourceProxy.getConnection(DataSourceProxy.java:131) at org.onap.ccsdk.sli.core.dblib.CachedDataSource.getConnection(CachedDataSource.java:121) at org.onap.ccsdk.sli.core.dblib.CachedDataSource.testConnection(CachedDataSource.java:369) at org.onap.ccsdk.sli.core.dblib.CachedDataSource.testConnection(CachedDataSource.java:359) at org.onap.ccsdk.sli.core.dblib.DBResourceManager$RecoveryMgr.resetConnectionPool(DBResourceManager.java:442) at org.onap.ccsdk.sli.core.dblib.DBResourceManager$RecoveryMgr.run(DBResourceManager.java:415) Caused by: java.sql.SQLException: Could not connect: Access denied for user 'sdnctl'@'10.42.7.67' (using password: YES) Current charset is UTF-8. If password has been set using other charset, consider using option 'passwordCharacterEncoding' at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.authentication(AbstractConnectProtocol.java:785) at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.handleConnectionPhases(AbstractConnectProtocol.java:715) at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.connect(AbstractConnectProtocol.java:403) at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1035) at org.mariadb.jdbc.internal.util.Utils.retrieveProxy(Utils.java:490) at org.mariadb.jdbc.Driver.connect(Driver.java:97) ... 14 more
Container used during deploy:
for i in $(kubectl get pods -n onap | grep dev-sdnc | awk '{print $1}'); do echo $i; kubectl describe pod $i -n onap | grep Image:; done dev-sdnc-0 Image: dibi/envsubst Image: oomk8s/readiness-check:2.0.2 Image: oomk8s/readiness-check:2.0.2 Image: nexus.onap.dyn.nesc.nokia.net:10001/onap/aaf/aaf_agent:2.1.15 Image: busybox Image: nexus.onap.dyn.nesc.nokia.net:10001/onap/sdnc-image:1.7.6 Image: docker.elastic.co/beats/filebeat:5.5.0 dev-sdnc-ansible-server-7c67dc5dff-d9x2l Image: dibi/envsubst Image: oomk8s/readiness-check:2.0.2 Image: nexus.onap.dyn.nesc.nokia.net:10001/onap/sdnc-ansible-server-image:1.7.6 dev-sdnc-db-0 Image: nexus.onap.dyn.nesc.nokia.net:10001/busybox Image: nexus.onap.dyn.nesc.nokia.net:10001/adfinissygroup/k8s-mariadb-galera-centos:v002 dev-sdnc-dbinit-job-v2lsm Image: dibi/envsubst Image: oomk8s/readiness-check:2.0.2 Image: nexus.onap.dyn.nesc.nokia.net:10001/onap/sdnc-image:1.7.6 dev-sdnc-dgbuilder-6b87c5b58c-t5wbz Image: dibi/envsubst Image: oomk8s/readiness-check:2.0.2 Image: nexus.onap.dyn.nesc.nokia.net:10001/onap/ccsdk-dgbuilder-image:0.6.3 dev-sdnc-dmaap-listener-98b67b787-wff57 Image: dibi/envsubst Image: oomk8s/readiness-check:2.0.2 Image: nexus.onap.dyn.nesc.nokia.net:10001/onap/sdnc-dmaap-listener-image:1.7.6 dev-sdnc-ueb-listener-7c5f4b4858-mggzh Image: dibi/envsubst Image: oomk8s/readiness-check:2.0.2 Image: nexus.onap.dyn.nesc.nokia.net:10001/onap/sdnc-ueb-listener-image:1.7.6
Robot health check is passing:
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
POD status:
ubuntu@onap-5428-rke-node:~/oom/kubernetes/robot$ kubectl get pods -n onap | grep dev-sdnc
dev-sdnc-0 2/2 Running 0 154m
dev-sdnc-ansible-server-7c67dc5dff-d9x2l 1/1 Running 0 154m
dev-sdnc-db-0 1/1 Running 0 154m
dev-sdnc-dbinit-job-v2lsm 0/1 Completed 0 154m
dev-sdnc-dgbuilder-6b87c5b58c-t5wbz 1/1 Running 0 154m
dev-sdnc-dmaap-listener-98b67b787-wff57 1/1 Running 0 154m
dev-sdnc-ueb-listener-7c5f4b4858-mggzh 1/1 Running 2 154m