Loading...

Type: Bug
Resolution: Cannot Reproduce
Priority: Highest
Fix Version/s: Casablanca Release
Affects Version/s: Beijing Release
Component/s: None
Labels:
None

Epic Link:
On-boarding and Stabilization of OOF seed code

This is happening during optf-has CSIT automation testing.

It is NOT systematic as there are run successfully completed and run ending with error.

It is affecting optf-has but looks like the issue is related to Music : so it is assigned to Tom.

Error links:

https://jenkins.onap.org/view/optf/job/optf-has-master-csit-has/52/consoleFull

https://jenkins.onap.org/view/optf/job/optf-has-master-csit-has/47/consoleFull

The error is happening always when optf-has onbording request is sent to music.

If that fails all subsequent test cases are affected.

We saw 2 different cases:

MUSIC is replying with HTTP 500 (see below)
MUSIC is replying with HTTP 400 (see below)

17:52:33 +++ curl -vvvvv --noproxy '*' --request POST http://172.17.0.3:8080/MUSIC/rest/v2/admin/onboardAppWithMusic -H 'Content-Type: application/json' --data @/w/workspace/optf-has-master-csit-has/test/csit/tests/optf-has/has/data/onboard.json
17:52:33 Note: Unnecessary use of -X or --request, POST is already inferred.
17:52:33 *   Trying 172.17.0.3...
17:52:33   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
17:52:33                                  Dload  Upload   Total   Spent    Left  Speed
17:52:33 
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* Connected to 172.17.0.3 (172.17.0.3) port 8080 (#0)
17:52:33 > POST /MUSIC/rest/v2/admin/onboardAppWithMusic HTTP/1.1
17:52:33 > Host: 172.17.0.3:8080
17:52:33 > User-Agent: curl/7.47.0
17:52:33 > Accept: */*
17:52:33 > Content-Type: application/json
17:52:33 > Content-Length: 104
17:52:33 > 
17:52:33 } [104 bytes data]
17:52:33 * upload completely sent off: 104 out of 104 bytes
17:52:33 < HTTP/1.1 500 Internal Server Error
17:52:33 < Server: Apache-Coyote/1.1
17:52:33 < X-latestVersion: 2.4.22
17:52:33 < Content-Type: text/html;charset=utf-8
17:52:33 < Content-Language: en
17:52:33 < Content-Length: 4751
17:52:33 < Date: Tue, 27 Mar 2018 17:52:33 GMT
17:52:33 < Connection: close
17:52:33 < 
17:52:33 { [4751 bytes data]
17:52:33 <!DOCTYPE html><html><head><title>Apache Tomcat/8.0.50 - Error report</title><style type="text/css">H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}.line {height: 1px; background-color: #525D76; border: none;}</style> </head><body><h1>HTTP Status 500 - unconfigured table keyspace_master</h1><div class="line"></div><p><b>type</b> Exception report</p><p><b>message</b> <u>unconfigured table keyspace_master</u></p><p><b>description</b> <u>The server encountered an internal error that prevented it from fulfilling this request.</u></p><p><b>exception</b></p><pre>com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured table keyspace_master
17:52:33 	com.datastax.driver.core.exceptions.InvalidQueryException.copy(InvalidQueryException.java:50)
17:52:33 	com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37)
17:52:33 	com.datastax.driver.core.AbstractSession.prepare(AbstractSession.java:104)
17:52:33 	org.onap.music.datastore.MusicDataStore.executeEventualGet(MusicDataStore.java:378)
17:52:33 	org.onap.music.main.MusicCore.get(MusicCore.java:702)
17:52:33 	org.onap.music.rest.RestMusicAdminAPI.onboardAppWithMusic(RestMusicAdminAPI.java:91)
17:52:33 	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
17:52:33 	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
17:52:33 	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
17:52:33 	java.lang.reflect.Method.invoke(Method.java:606)
17:52:33 	com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
17:52:33 	com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
17:52:33 	com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
17:52:33 	com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
17:52:33 	com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
17:52:33 	com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
17:52:33 	com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
17:52:33 	com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
17:52:33 	com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
17:52:33 	com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
17:52:33 	com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
17:52:33 	com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
17:52:33 	com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
17:52:33 	com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
17:52:33 	com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
17:52:33 	javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
17:52:33 	org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
17:52:33 </pre><p><b>root cause</b></p><pre>com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured table keyspace_master
17:52:33 	com.datastax.driver.core.Responses$Error.asException(Responses.java:147)
17:52:33 	com.datastax.driver.core.SessionManager$4.apply(SessionManager.java:220)
17:52:33 	com.datastax.driver.core.SessionManager$4.apply(SessionManager.java:196)
17:52:33 	com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
17:52:33 	com.google.common.util.concurrent.Futures$AsyncChainingFuture.
100  4855  100  4751  100   104  23383    511 --:--:-- --:--:-- --:--:-- 23403
17:52:33 * Closing connection 0
17:52:33 doTransform(Futures.java:1433)
17:52:33 	com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
17:52:33 	com.google.common.util.concurrent.Futures$2$1.run(Futures.java:1177)
17:52:33 	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
17:52:33 	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
17:52:33 	io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
17:52:33 	java.lang.Thread.run(Thread.java:748)
17:52:33 </pre><p><b>note</b> <u>The full stack trace of the root cause is available in the Apache Tomcat/8.0.50 logs.</u></p><hr class="line"><h3>Apache Tomcat/8.0.50</h3></body></html>

13:10:42 +++ curl -vvvvv --noproxy '*' --request POST http://172.17.0.3:8080/MUSIC/rest/v2/admin/onboardAppWithMusic -H 'Content-Type: application/json' --data @/w/workspace/optf-has-master-csit-has/test/csit/tests/optf-has/has/data/onboard.json
13:10:42 Note: Unnecessary use of -X or --request, POST is already inferred.
13:10:42 *   Trying 172.17.0.3...
13:10:42   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
13:10:42                                  Dload  Upload   Total   Spent    Left  Speed
13:10:42 
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* Connected to 172.17.0.3 (172.17.0.3) port 8080 (#0)
13:10:42 > POST /MUSIC/rest/v2/admin/onboardAppWithMusic HTTP/1.1
13:10:42 > Host: 172.17.0.3:8080
13:10:42 > User-Agent: curl/7.47.0
13:10:42 > Accept: */*
13:10:42 > Content-Type: application/json
13:10:42 > Content-Length: 104
13:10:42 > 
13:10:42 } [104 bytes data]
13:10:42 * upload completely sent off: 104 out of 104 bytes
13:10:42 < HTTP/1.1 400 Bad Request
13:10:42 < Server: Apache-Coyote/1.1
13:10:42 < Content-Type: application/json
13:10:42 < Transfer-Encoding: chunked
13:10:42 < Date: Thu, 29 Mar 2018 13:10:42 GMT
13:10:42 < Connection: close
13:10:42 < 
13:10:42 { [71 bytes data]
13:10:42 
100   169    0    65  100   104    159    254 --:--:-- --:--:-- --:--:--   255
13:10:42 * Closing connection 0
13:10:42 {"error":"unconfigured table keyspace_master","status":"FAILURE"}

relates to

MUSIC-100 MUSIC CSIT failures

Closed

OPTFRA-259 Fix intermittent failure of HAS CSIT job

Closed

Details

Description

Attachments

Issue Links

Activity

People

Dates