""2018-11-13 13:40:01,799 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:01,804 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-INIT audit1 ****** audit1 from Remote10.42.198.56
""2018-11-13 13:40:01,804 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:40:01:804", "topicId":"POA-AUDIT-INIT", "publisherId":"null", "publisherIp":"null", "subscriberId":"audit1", "subscriberIp":"10.42.198.56"}
""2018-11-13 13:40:01,804 [qtp1061804750-50155] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:40:01,821 [qtp1061804750-49165] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:40:01,822 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.198.56
""2018-11-13 13:40:01,823 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents Authorization 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:40:01,823 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-INIT::audit1::audit1: 2.4 empty replies/minute.
""2018-11-13 13:40:01,823 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents getConsumerFor 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:40:01,923 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:06,824 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:07,027 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:09,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - consumer POA-AUDIT-INIT::group1::C1 has expired
""2018-11-13 13:40:09,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - closing Kafka consumer POA-AUDIT-INIT::group1::C1 object org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer@45ed615f
""2018-11-13 13:40:09,808 [pool-18500-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:40:09,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:40:09,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
"2018-11-13 13:40:11,930 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:12,131 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:12,135 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-RULE-VALIDATION poa-validator-test ****** test from Remote10.42.182.65
""2018-11-13 13:40:12,135 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:40:12:135", "topicId":"POA-RULE-VALIDATION", "publisherId":"null", "publisherIp":"null", "subscriberId":"test", "subscriberIp":"10.42.182.65"}
""2018-11-13 13:40:12,135 [qtp1061804750-49969] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:40:15,147 [qtp1061804750-50229] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:40:15,148 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.182.65
""2018-11-13 13:40:15,149 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents Authorization 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:40:15,149 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-RULE-VALIDATION::poa-validator-test::test: 2.8 empty replies/minute.
""2018-11-13 13:40:15,149 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents getConsumerFor 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:40:17,034 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:17,038 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-INIT audit1 ****** audit1 from Remote10.42.198.56
""2018-11-13 13:40:17,038 [qtp1061804750-49165] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:40:17:038", "topicId":"POA-AUDIT-INIT", "publisherId":"null", "publisherIp":"null", "subscriberId":"audit1", "subscriberIp":"10.42.198.56"}
""2018-11-13 13:40:17,038 [qtp1061804750-49165] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:40:17,062 [qtp1061804750-50155] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:40:17,062 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.198.56
""2018-11-13 13:40:17,063 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents Authorization 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:40:17,063 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-INIT::audit1::audit1: 2.6 empty replies/minute.
""2018-11-13 13:40:17,063 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents getConsumerFor 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:40:20,150 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:22,064 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:22,125 [qtp1061804750-47876] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:40:22,126 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-RESULT/poaConsumer/poaConsumer] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.245.29
""2018-11-13 13:40:22,126 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.security.impl.DMaaPOriginalUebAuthenticator - AUTH-LOG(10.42.245.29): Bad X-Auth header format (null)
""2018-11-13 13:40:22,126 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.security.impl.DMaaPOriginalUebAuthenticator - AUTH-LOG(10.42.245.29): Bad X-Auth header format (null)
""2018-11-13 13:40:22,127 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-RESULT/poaConsumer/poaConsumer] Time taken in getEvents Authorization 1 ms for POA-AUDIT-RESULT poaConsumer poaConsumer
""2018-11-13 13:40:22,127 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-RESULT::poaConsumer::poaConsumer: 1.2 empty replies/minute.
""2018-11-13 13:40:22,127 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-RESULT/poaConsumer/poaConsumer] Time taken in getEvents getConsumerFor 1 ms for POA-AUDIT-RESULT poaConsumer poaConsumer
""2018-11-13 13:40:24,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - consumer POA-AUDIT-INIT::group1::C1 has expired
""2018-11-13 13:40:24,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - closing Kafka consumer POA-AUDIT-INIT::group1::C1 object org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer@45ed615f
""2018-11-13 13:40:24,808 [pool-18507-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:40:24,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:40:24,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
"2018-11-13 13:40:25,254 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:27,127 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-RESULT::poaConsumer] now,
""2018-11-13 13:40:27,170 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:30,359 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:30,362 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-RULE-VALIDATION poa-validator-test ****** test from Remote10.42.182.65
""2018-11-13 13:40:30,362 [qtp1061804750-50229] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:40:30:362", "topicId":"POA-RULE-VALIDATION", "publisherId":"null", "publisherIp":"null", "subscriberId":"test", "subscriberIp":"10.42.182.65"}
""2018-11-13 13:40:30,362 [qtp1061804750-50229] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:40:32,232 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-RESULT::poaConsumer] now,
""2018-11-13 13:40:32,273 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:32,276 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-INIT audit1 ****** audit1 from Remote10.42.198.56
""2018-11-13 13:40:32,276 [qtp1061804750-50155] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:40:32:276", "topicId":"POA-AUDIT-INIT", "publisherId":"null", "publisherIp":"null", "subscriberId":"audit1", "subscriberIp":"10.42.198.56"}
""2018-11-13 13:40:32,276 [qtp1061804750-50155] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:40:32,290 [qtp1061804750-50269] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:40:32,291 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.198.56
""2018-11-13 13:40:32,292 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents Authorization 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:40:32,292 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-INIT::audit1::audit1: 2.8 empty replies/minute.
""2018-11-13 13:40:32,292 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents getConsumerFor 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:40:33,375 [qtp1061804750-49969] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:40:33,376 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.182.65
""2018-11-13 13:40:33,377 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents Authorization 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:40:33,377 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-RULE-VALIDATION::poa-validator-test::test: 3.0 empty replies/minute.
""2018-11-13 13:40:33,377 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents getConsumerFor 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:40:37,292 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:37,337 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-RESULT::poaConsumer] now,
""2018-11-13 13:40:37,340 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-RESULT poaConsumer ****** poaConsumer from Remote10.42.245.29
""2018-11-13 13:40:37,340 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-RESULT/poaConsumer/poaConsumer] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:40:37:340", "topicId":"POA-AUDIT-RESULT", "publisherId":"null", "publisherIp":"null", "subscriberId":"poaConsumer", "subscriberIp":"10.42.245.29"}
""2018-11-13 13:40:37,340 [qtp1061804750-47876] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:40:38,377 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:39,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - consumer POA-AUDIT-INIT::group1::C1 has expired
""2018-11-13 13:40:39,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - closing Kafka consumer POA-AUDIT-INIT::group1::C1 object org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer@45ed615f
""2018-11-13 13:40:39,808 [pool-18516-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:40:39,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:40:39,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
"2018-11-13 13:40:42,397 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:43,481 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:47,501 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:47,504 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-INIT audit1 ****** audit1 from Remote10.42.198.56
""2018-11-13 13:40:47,504 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:40:47:504", "topicId":"POA-AUDIT-INIT", "publisherId":"null", "publisherIp":"null", "subscriberId":"audit1", "subscriberIp":"10.42.198.56"}
""2018-11-13 13:40:47,505 [qtp1061804750-50269] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:40:47,519 [qtp1061804750-47876] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:40:47,520 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.198.56
""2018-11-13 13:40:47,520 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents Authorization 0 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:40:47,520 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-INIT::audit1::audit1: 3.0 empty replies/minute.
""2018-11-13 13:40:47,520 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents getConsumerFor 0 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:40:48,586 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:48,590 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Sent 0 msgs in 15214 ms; committed to offset 0 for POA-RULE-VALIDATION poa-validator-test test on to the server 10.42.182.65
""2018-11-13 13:40:51,617 [qtp1061804750-50041] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:40:51,618 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.182.65
""2018-11-13 13:40:51,619 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents Authorization 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:40:51,619 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-RULE-VALIDATION::poa-validator-test::test: 3.2 empty replies/minute.
""2018-11-13 13:40:51,619 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents getConsumerFor 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:40:52,521 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:40:54,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - consumer POA-AUDIT-INIT::group1::C1 has expired
""2018-11-13 13:40:54,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - closing Kafka consumer POA-AUDIT-INIT::group1::C1 object org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer@45ed615f
""2018-11-13 13:40:54,808 [pool-18522-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:40:54,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:40:54,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
"2018-11-13 13:40:56,620 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:40:57,626 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:01,725 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:41:02,730 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:02,735 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-INIT audit1 ****** audit1 from Remote10.42.198.56
""2018-11-13 13:41:02,735 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:41:02:735", "topicId":"POA-AUDIT-INIT", "publisherId":"null", "publisherIp":"null", "subscriberId":"audit1", "subscriberIp":"10.42.198.56"}
""2018-11-13 13:41:02,735 [qtp1061804750-47876] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:41:02,753 [qtp1061804750-50269] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:41:02,753 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.198.56
""2018-11-13 13:41:02,754 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents Authorization 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:41:02,754 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-INIT::audit1::audit1: 3.2 empty replies/minute.
""2018-11-13 13:41:02,754 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents getConsumerFor 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:41:06,830 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:41:06,834 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-RULE-VALIDATION poa-validator-test ****** test from Remote10.42.182.65
""2018-11-13 13:41:06,834 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:41:06:834", "topicId":"POA-RULE-VALIDATION", "publisherId":"null", "publisherIp":"null", "subscriberId":"test", "subscriberIp":"10.42.182.65"}
""2018-11-13 13:41:06,834 [qtp1061804750-50041] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:41:07,348 [qtp1061804750-47876] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:41:07,348 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-RESULT/poaConsumer/poaConsumer] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.245.29
""2018-11-13 13:41:07,348 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.security.impl.DMaaPOriginalUebAuthenticator - AUTH-LOG(10.42.245.29): Bad X-Auth header format (null)
""2018-11-13 13:41:07,348 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.security.impl.DMaaPOriginalUebAuthenticator - AUTH-LOG(10.42.245.29): Bad X-Auth header format (null)
""2018-11-13 13:41:07,350 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-RESULT/poaConsumer/poaConsumer] Time taken in getEvents Authorization 2 ms for POA-AUDIT-RESULT poaConsumer poaConsumer
""2018-11-13 13:41:07,350 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-RESULT::poaConsumer::poaConsumer: 1.4 empty replies/minute.
""2018-11-13 13:41:07,350 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-RESULT/poaConsumer/poaConsumer] Time taken in getEvents getConsumerFor 2 ms for POA-AUDIT-RESULT poaConsumer poaConsumer
""2018-11-13 13:41:07,755 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:09,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - consumer POA-AUDIT-INIT::group1::C1 has expired
""2018-11-13 13:41:09,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - closing Kafka consumer POA-AUDIT-INIT::group1::C1 object org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer@45ed615f
""2018-11-13 13:41:09,808 [pool-18529-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:41:09,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:41:09,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
"2018-11-13 13:41:09,847 [qtp1061804750-50041] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:41:09,848 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.182.65
""2018-11-13 13:41:09,850 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents Authorization 2 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:41:09,850 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-RULE-VALIDATION::poa-validator-test::test: 3.4 empty replies/minute.
""2018-11-13 13:41:09,850 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents getConsumerFor 2 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:41:12,350 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-RESULT::poaConsumer] now,
""2018-11-13 13:41:12,860 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:14,850 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:41:17,455 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-RESULT::poaConsumer] now,
""2018-11-13 13:41:17,967 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:17,972 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-INIT audit1 ****** audit1 from Remote10.42.198.56
""2018-11-13 13:41:17,972 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:41:17:972", "topicId":"POA-AUDIT-INIT", "publisherId":"null", "publisherIp":"null", "subscriberId":"audit1", "subscriberIp":"10.42.198.56"}
""2018-11-13 13:41:17,972 [qtp1061804750-50269] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:41:17,986 [qtp1061804750-49969] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:41:17,986 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.198.56
""2018-11-13 13:41:17,987 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents Authorization 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:41:17,987 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-INIT::audit1::audit1: 3.4 empty replies/minute.
""2018-11-13 13:41:17,987 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents getConsumerFor 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:41:19,955 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:41:22,559 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-RESULT::poaConsumer] now,
""2018-11-13 13:41:22,563 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-RESULT poaConsumer ****** poaConsumer from Remote10.42.245.29
""2018-11-13 13:41:22,563 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-RESULT/poaConsumer/poaConsumer] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:41:22:563", "topicId":"POA-AUDIT-RESULT", "publisherId":"null", "publisherIp":"null", "subscriberId":"poaConsumer", "subscriberIp":"10.42.245.29"}
""2018-11-13 13:41:22,564 [qtp1061804750-47876] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:41:22,988 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:24,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - consumer POA-AUDIT-INIT::group1::C1 has expired
""2018-11-13 13:41:24,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - closing Kafka consumer POA-AUDIT-INIT::group1::C1 object org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer@45ed615f
""2018-11-13 13:41:24,808 [pool-18538-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:41:24,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:41:24,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
"2018-11-13 13:41:25,059 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:41:25,063 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-RULE-VALIDATION poa-validator-test ****** test from Remote10.42.182.65
""2018-11-13 13:41:25,063 [qtp1061804750-50041] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:41:25:063", "topicId":"POA-RULE-VALIDATION", "publisherId":"null", "publisherIp":"null", "subscriberId":"test", "subscriberIp":"10.42.182.65"}
""2018-11-13 13:41:25,063 [qtp1061804750-50041] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:41:28,076 [qtp1061804750-50493] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:41:28,077 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.182.65
""2018-11-13 13:41:28,078 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents Authorization 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:41:28,078 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-RULE-VALIDATION::poa-validator-test::test: 2.8 empty replies/minute.
""2018-11-13 13:41:28,078 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents getConsumerFor 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:41:28,093 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:33,079 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:41:33,197 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:33,200 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-INIT audit1 ****** audit1 from Remote10.42.198.56
""2018-11-13 13:41:33,200 [qtp1061804750-49969] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:41:33:200", "topicId":"POA-AUDIT-INIT", "publisherId":"null", "publisherIp":"null", "subscriberId":"audit1", "subscriberIp":"10.42.198.56"}
""2018-11-13 13:41:33,201 [qtp1061804750-49969] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:41:33,217 [qtp1061804750-47876] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:41:33,218 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.198.56
""2018-11-13 13:41:33,219 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents Authorization 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:41:33,219 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-INIT::audit1::audit1: 3.6 empty replies/minute.
""2018-11-13 13:41:33,219 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents getConsumerFor 1 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:41:38,183 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:41:38,220 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:39,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - consumer POA-AUDIT-INIT::group1::C1 has expired
""2018-11-13 13:41:39,808 [pool-5-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaConsumerCache - closing Kafka consumer POA-AUDIT-INIT::group1::C1 object org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer@45ed615f
""2018-11-13 13:41:39,808 [pool-18545-thread-1] INFO  org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:41:39,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
""2018-11-13 13:41:39,808 [pool-5-thread-1] ERROR org.onap.dmaap.dmf.mr.backends.kafka.Kafka011Consumer - Exception occured Occured - Kafka connection closure with in 300 seconds by a Executors taskjava.util.concurrent.ExecutionException: java.lang.Exception: @Kafka Stream shutdown erorr occurred POA-AUDIT-INIT : group1 : C1 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
"2018-11-13 13:41:43,288 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-RULE-VALIDATION::poa-validator-test] now,
""2018-11-13 13:41:43,292 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-RULE-VALIDATION poa-validator-test ****** test from Remote10.42.182.65
""2018-11-13 13:41:43,292 [qtp1061804750-50493] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:41:43:292", "topicId":"POA-RULE-VALIDATION", "publisherId":"null", "publisherIp":"null", "subscriberId":"test", "subscriberIp":"10.42.182.65"}
""2018-11-13 13:41:43,292 [qtp1061804750-50493] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:41:43,323 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:46,324 [qtp1061804750-50075] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:41:46,325 [qtp1061804750-50075] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.182.65
""2018-11-13 13:41:46,326 [qtp1061804750-50075] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents Authorization 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:41:46,326 [qtp1061804750-50075] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-RULE-VALIDATION::poa-validator-test::test: 3.0 empty replies/minute.
""2018-11-13 13:41:46,326 [qtp1061804750-50075] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-RULE-VALIDATION/poa-validator-test/test] Time taken in getEvents getConsumerFor 1 ms for POA-RULE-VALIDATION poa-validator-test test
""2018-11-13 13:41:48,428 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.backends.kafka.KafkaLiveLockAvoider2 - Signalling unlock to all conumsers of in group [POA-AUDIT-INIT::audit1] now,
""2018-11-13 13:41:48,432 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - KafkaConsumer is not safe for multi-threaded accesson POA-AUDIT-INIT audit1 ****** audit1 from Remote10.42.198.56
""2018-11-13 13:41:48,432 [qtp1061804750-47876] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] ErrorResponse {"httpStatusCode":"409", "mrErrorCode":"5012", "errorMessage":"Couldn't respond to client, possible of consumer requests from more than one server. Please contact MR team if you see this issue occurs continously", "helpURL":"http://onap.readthedocs.io", "statusTs":"13-11-2018::01:41:48:432", "topicId":"POA-AUDIT-INIT", "publisherId":"null", "publisherIp":"null", "subscriberId":"audit1", "subscriberIp":"10.42.198.56"}
""2018-11-13 13:41:48,432 [qtp1061804750-47876] INFO  org.onap.dmaap.DMaaPCambriaExceptionMapper - Reached Cambria Exception Mapper..
""2018-11-13 13:41:48,447 [qtp1061804750-50269] INFO  org.onap.dmaap.util.DMaaPAuthFilter - inside servlet filter Cambria Auth Headers checking before doing other Authentication
""2018-11-13 13:41:48,448 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] fetch: timeout=15000, limit=1000, filter= from Remote host 10.42.198.56
""2018-11-13 13:41:48,448 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents Authorization 0 ms for POA-AUDIT-INIT audit1 audit1
""2018-11-13 13:41:48,449 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.beans.DMaaPCambriaLimiter - POA-AUDIT-INIT::audit1::audit1: 3.8 empty replies/minute.
""2018-11-13 13:41:48,449 [qtp1061804750-50269] INFO  org.onap.dmaap.dmf.mr.service.impl.EventsServiceImpl - [POA-AUDIT-INIT/audit1/audit1] Time taken in getEvents getConsumerFor 1 ms for POA-AUDIT-INIT audit1 audit1