Uploaded image for project: 'Data Collection, Analytics, and Events'
  1. Data Collection, Analytics, and Events
  2. DCAEGEN2-638

DataFile Collector micro service

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Done
    • Icon: Medium Medium
    • None
    • None
    • None

      The Data Collector needs to be introduced within DCAE platform.
      This service will orchestrate the collection of bulk M data flow:

      1. Subscribes to fileReady DMaaP topic
      2. Collect the file from the PNF.
      3. Send new event to DataRouter with file

        1.
        		 Initial template project structure Sub-task Closed elinuxhenrik
        2.
        		 Dmaap Consumer & Producer Implementation Sub-task Closed elinuxhenrik
        3.
        		 subscribe to dmaap message router Sub-task Closed yanhuanwang
        4.
        		 Based on router message, we fetch file from node Sub-task Closed yanhuanwang
        5.
        		 after collecting file ,we publish to data router Sub-task Closed yanhuanwang
        6.
        		 Containerization - Docker Sub-task Closed yanhuanwang
        7.
        		 User Documentation Sub-task Closed maximesson
        8.
        		 Adapt to new VES specifications Sub-task Closed elinuxhenrik
        9.
        		 Integrate secured communication through FTPES Sub-task Closed yanhuanwang
        10.
        		 Adapt to configuration in cloud environment Sub-task Closed przemyslaw.wasala
        11.
        		 History of success/fail for pulls Sub-task Closed yanhuanwang
        12.
        		 Integrate with Data Router Sub-task Closed elinuxhenrik
        13.
        		 Improve use of reactive framework Sub-task Closed yanhuanwang
        14.
        		 Retry mechanism Sub-task Closed elinuxhenrik
        15.
        		 Fix Sonar Sub-task Closed elinuxhenrik
        16.
        		 Update the ports Sub-task Closed yanhuanwang
        17.
        		 Prepare message from DMaap Sub-task Closed elinuxhenrik
        18.
        		 Correct URL for DataRouter publication Sub-task Closed elinuxhenrik
        19.
        		 Use correct Content Type from DMaaP Sub-task Closed elinuxhenrik
        20.
        		 Add Http configuration Sub-task Closed elinuxhenrik
        21.
        		 Configuration missing for docker build Sub-task Closed elinuxhenrik
        22.
        		 Fixing Sonar Issues Sub-task Closed pwielebs
        23.
        		 Message not delivered to DataRouter Sub-task Closed elinuxhenrik
        24.
        		 Create a new Nexus image Sub-task Closed elinuxhenrik
        25.
        		 Redirect from DataRouter not handled properly Sub-task Closed elinuxhenrik
        26.
        		 Mutual authentication does not work properly Sub-task Closed elinuxhenrik
        27.
        		 Retry when file collection fails doesn't work properly Sub-task Closed elinuxhenrik
        28.
        		 blueprint needs update for ftp tls configuration Sub-task Closed yanhuanwang
        29.
        		 MR respond with 429 code Sub-task Closed yanhuanwang
        30.
        		 version update from 1.0.2 to 1.0.3 Sub-task Closed yanhuanwang
        31.
        		 increase code coverage Sub-task Closed micdzied
        32.
        		 add code to validate changeType & changeIdentifier Sub-task Closed yanhuanwang
        33.
        		 update meta-data Sub-task Closed yanhuanwang
        34.
        		 dfc documentation Sub-task Closed elinuxhenrik
        35.
        		 SSL peer shut down incorrectly Sub-task Closed elinuxhenrik
        36.
        		 version update from 1.0.3 to 1.0.4 Sub-task Closed yanhuanwang
        37.
        		 Update “master” version for DFC 1.1.0 Sub-task Closed yanhuanwang
        38.
        		 Handle multiple fileReady message in one go Sub-task Closed yanhuanwang
        39.
        		 refactor/improve certificate handling Sub-task Closed yanhuanwang

            elinuxhenrik elinuxhenrik
            elinuxhenrik elinuxhenrik
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: