Uploaded image for project: 'Data Collection, Analytics, and Events'
  1. Data Collection, Analytics, and Events
  2. DCAEGEN2-2217

5G Bulk PM use case is not working

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: High High
    • Frankfurt Release
    • Frankfurt Release
    • None

      In Frankfurt release has been introduced automated E2E test cases for 5G bulk PM

      In task https://jira.onap.org/browse/INT-1521  https://gerrit.onap.org/r/c/testsuite/+/105492 has been introduced required changes in order to use PM Mapper and Data File Collector blueprints from dace inventory.

      After E2E test case run at laboratory installed using master branch from Tuesday we noticed that there is an issue between Data File Collector and Data Router. In order to see logs in DFC and PM Mapper before test case execution we turned off teardown removing those two pods:

      • at robot pod edit following file vim /var/opt/ONAP/robot/testsuites/usecases/5gbulkpm.robot 
      • remove line with suite teardown
      • logs from test case execution ete_5gbulkpm.zip
      • logs from dfc dfc_application.log

      Issues:

      • during dfc file publish to DR node we have following error:
      org.onap.dcaegen2.collectors.datafile.tasks.DataRouterPublisher     |2020-04-24T14:29:00.627Z     |WARN     |Publishing file A1587738448.6.xml.gz to DR unsuccessful. Response code: 403 FORBIDDEN     |RequestID=A1587738448.6.xml.gz     |     |     |parallel-1     |
org.onap.dcaegen2.collectors.datafile.tasks.ScheduledTasks     |2020-04-24T14:29:00.628Z     |ERROR     |File publishing failed: FilePublishInformation{productName=RnNode, vendorName=Ericsson, lastEpochMicrosec=8745745764578, sourceName=oteNB5309, startEpochMicrosec=8745745764578, timeZoneOffset=UTC+05.30, location=####, compression=gzip, fileFormatType=org.3GPP.32.435#measCollec, fileFormatVersion=V10, internalLocation=/tmp/onap_datafile/A1587738448.6.xml.gz, name=A1587738448.6.xml.gz, context={RequestID=A1587738448.6.xml.gz}, changeIdentifier=PM_MEAS_FILES}     |RequestID=A1587738448.6.xml.gz     |     |     |parallel-1     |
      • also in logs we see some strange file: oteNB5309 test.xml.gz isn't it something hard coded (used in csit), generating some nasty errors in log files

      Test has been also executed manually and same problem appeared.

      Also we tried to turn on TLS by setting use_tls flag to true and setting in consul for DFC and

        "dmaap.security.enableDmaapCertAuth": true,

      in Consul. Thee were still some issues with path to certificates that are wrongly defined in dfc blueprint loaded by bootstrap and application was not working. **

      After correction in consul following configuration started to work but issue with 403 still exists**

      dmaap.ftpesConfig.keyCert: /opt/app/datafile/config/cert.jks        
dmaap.ftpesConfig.keyPasswordPath: /opt/app/datafile/config/jks.pass        
dmaap.ftpesConfig.trustedCa: /opt/app/datafile/config/trust.jks        
dmaap.ftpesConfig.trustedCaPasswordPath: /opt/app/datafile/etc/cert/trust.pass        
 dmaap.security.enableDmaapCertAuth:false          ---> true        
dmaap.security.keyStorePasswordPath: /opt/app/datafile/etc/cert/key.pass          ---> p12.pass
 dmaap.security.keyStorePath: /opt/app/datafile/etc/cert/key.p12                  ---> cert.p12        
dmaap.security.trustStorePasswordPath: /opt/app/datafile/etc/cert/trust.pass        
 dmaap.security.trustStorePath: /opt/app/datafile/etc/cert/trust.jks

      Also we tried manually put  file to feed:

      • user and pass taken from already created feed configuration
      • error is same independent form place from which command has been originated/called
      • during request both internal dmaap-dr ip/port, external dmaap-dr ip/port has been used an both gave same error

      Request:

      curl -k -X PUT --user tmp_2j6pq0u8k14mluz:cu8k9ixhcom4spc -H "Content-Type:application/octet-stream"  -H "X-DMAAP-DR-META:{\"filetype\":\"gzip\"}" --data-binary @magda_test_1.xml.gz --post301 --location-trusted https://10.74.70.83:30269/publish/1/magda_test_1.xml.gz -vv

      Response:

      *   Trying 10.74.70.83...
* TCP_NODELAY set
* Connected to 10.74.70.83 (10.74.70.83) port 30269 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
*   CAfile: /etc/ssl/certs/ca-certificates.crt
  CApath: /etc/ssl/certs
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
* TLSv1.2 (IN), TLS handshake, Request CERT (13):
* TLSv1.2 (IN), TLS handshake, Server finished (14):
* TLSv1.2 (OUT), TLS handshake, Certificate (11):
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
* TLSv1.2 (OUT), TLS change cipher, Client hello (1):
* TLSv1.2 (OUT), TLS handshake, Finished (20):
* TLSv1.2 (IN), TLS handshake, Finished (20):
* SSL connection using TLSv1.2 / ECDHE-RSA-AES256-SHA384
* ALPN, server did not agree to a protocol
* Server certificate:
*  subject: CN=dmaap-dr-prov; OU=dmaap-dr-prov@dmaap-dr.onap.org:DEV; OU=OSAAF; O=ONAP; C=US
*  start date: Apr 21 15:14:23 2020 GMT
*  expire date: Apr 21 15:14:23 2021 GMT
*  issuer: C=US; O=ONAP; OU=OSAAF; CN=intermediateCA_9
*  SSL certificate verify result: unable to get local issuer certificate (20), continuing anyway.
* Server auth using Basic with user 'tmp_a1s83q43eocnm1m'
> PUT /publish/1/magda_test_1.xml.gz HTTP/1.1
> Host: 10.74.70.83:30269
> Authorization: Basic dG1wX2ExczgzcTQzZW9jbm0xbTo2ZmE1NzJ4eW5ybmxuY24=
> User-Agent: curl/7.58.0
> Accept: */*
> Content-Type:application/octet-stream
> X-DMAAP-DR-META:{"filetype":"gzip"}
> Content-Length: 0
>
< HTTP/1.1 301 Moved Permanently
< Location: https://dmaap-dr-node:8443/publish/1/magda_test_1.xml.gz
< Content-Length: 0
< Server: Jetty(9.4.20.v20190813)
* HTTP error before end of send, stop sending
<
* Closing connection 0
* TLSv1.2 (OUT), TLS alert, Client hello (1):
* Issue another request to this URL: 'https://dmaap-dr-node:8443/publish/1/magda_test_1.xml.gz'
*   Trying 10.43.210.192...
* TCP_NODELAY set
* Connected to dmaap-dr-node (10.43.210.192) port 8443 (#1)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
*   CAfile: /etc/ssl/certs/ca-certificates.crt
  CApath: /etc/ssl/certs
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
* TLSv1.2 (IN), TLS handshake, Server finished (14):
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
* TLSv1.2 (OUT), TLS change cipher, Client hello (1):
* TLSv1.2 (OUT), TLS handshake, Finished (20):
* TLSv1.2 (IN), TLS handshake, Finished (20):
* SSL connection using TLSv1.2 / ECDHE-RSA-AES256-SHA384
* ALPN, server did not agree to a protocol
* Server certificate:
*  subject: CN=dmaap-dr-node; OU=dmaap-dr-node@dmaap-dr.onap.org:DEV; OU=OSAAF; O=ONAP; C=US
*  start date: Apr 21 15:16:07 2020 GMT
*  expire date: Apr 21 15:16:07 2021 GMT
*  issuer: C=US; O=ONAP; OU=OSAAF; CN=intermediateCA_9
*  SSL certificate verify result: unable to get local issuer certificate (20), continuing anyway.
* Server auth using Basic with user 'tmp_a1s83q43eocnm1m'
> PUT /publish/1/magda_test_1.xml.gz HTTP/1.1
> Host: dmaap-dr-node:8443
> Authorization: Basic dG1wX2ExczgzcTQzZW9jbm0xbTo2ZmE1NzJ4eW5ybmxuY24=
> User-Agent: curl/7.58.0
> Accept: */*
> Content-Type:application/octet-stream
> X-DMAAP-DR-META:{"filetype":"gzip"}
> Content-Length: 0
>
< HTTP/1.1 403 Feed does not exist
< Date: Thu, 23 Apr 2020 12:47:11 GMT
< Strict-Transport-Security: max-age=2000; includeSubDomains
< Content-Length: 0
< Server: Jetty(9.4.20.v20190813)
* HTTP error before end of send, stop sending
<
* Closing connection 1
* TLSv1.2 (OUT), TLS alert, Client hello (1):

       

       

        1. command output.json
          3 kB
        2. dfc_application.log
          5 kB
        3. dr_node_error.log
          15 kB
        4. dr_node_jetty.log
          7 kB
        5. dr_node_metrics.log
          16 kB
        6. dr_prov_apicalls.log
          54 kB
        7. dr_prov_request.log
          3 kB
        8. ete_5gbulkpm.zip
          203 kB
        9. health.zip
          374 kB

            efiacor efiacor
            kkuzmick kkuzmick
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: