In R3, significant time was spent in making all existing components together even before testing new features of R3 (vFW HPA and vDNS HPA).

As part of Dublin, we need to ensure that any regression is found even before release testing starts.  

As part of this :

• Create a test program which automates multiple tests in automated fashion (all the tests that part of this: https://wiki.onap.org/pages/viewpage.action?pageId=41421112
  • Assumptions:
    • Multiple cloud-regions are deployed (Openstack installation)
  • Takes input :
    • Cloud-owner information for each cloud-region
    • Use existing ONAP vs create new ONAP
    • Input for rancher if it is new ONAP installation
    • Any input as necessary
  • Program (Can be done in golang, Python, whichever language you prefer)
    • Installs ONAP using rancher based on the input
    • Ensures that ONAP installed successfully 
    • Adds the cloud-regions via ESR CLI/GUI or via API (if CLI/GUI is not available) based on the input
    • For each test case (it is expected that all VNFs with various HEAT/ENV templates are prepared manually)
      • Preparation phase
        • Create ONAP tenant via CLI/GUI or API (if CLI/GUI not available)
        • Onboard VNF using SDC CLI/GUI or API 
        • Create service using SDC CLI/GUI or API
        • Create ONAP customer using A&AI CLI/GUI or API
        • Associate the service to ONAP tenant using A&AI CLI/GUI or API.
        • Create HPA policy using Policy CLI/GUI or API if no CLI/GUI
        • Associate HPA policy to VNF using Policy CLI/GUI or API if no CLI/GUI
      • Execution phase
        • Using VID CLI/GUI, create service instance.
        • Using VID CLI/GUI, associate VNF and VFs.
        • Capture (from Openstack) CLI/GUI, list the VMs and associated flavors chosen.
        • Ensure that flavor selected and region that is used to deploy are as per test.
        • Return Success/Failure
      • Termination phase
        • Terminate service instance using VID CLI/GUI
        • Remove VNF and Service using SDC CLI/GUI
  • If there are any problem elsewhere, generate log 

CI:

• On specific interval, create ONAP service images from the HEAD of the project.
• Execute above program 
• Report issues.