Description of Use Case / Requirement:

 Support for Test Task Auto Execution （NFV Testing Automatic Platform）:

• Goal- To achieve a more flexible NFV automated test platform, ONAP-based NFV automatic testing platform provides a flexible testing framework for testers, and enables output customized test reports (e.g. XML, Json, etc.).
• Business Impact- There are a large number of cross-department and cross-organization communications during the traditional network element, system or equipment network access test. And the manual errors are inevitable, the knowledge in test field cannot be solidified. The cost of each test is high and the test cycle is always long. After introducing NFV, because network element software and hardware equipment are layered decoupled, the introduction of a large number of open source components as well as the frequent upgrade of the software itself, make network access test become more complicated and frequent. Testing has become a bottleneck during the introduction and iteration of new technologies. Therefore, it is urgent to introduce the test task auto execution framework. By introducing test task auto execution framework and corresponding enhancements, it can realize the automatic execution of NFV test tasks, reduce labor costs, and improve test efficiency.
• Business Markets- After enabling NFV Automatic testing with ONAP, CSPs can leverage it to accelerate time to deployment for new network services, improve interoperability and software quality, and reduce in-house testing effort and reduce costs. Vendor can leverage it to deduce the cost of VNF developing, and improve time to revenue for new product offerings, achieve greater alignment with customer requirements from service provider, and demonstrate product quality through open ecosystem testing. Instrument manufacturers can integrate their test tools and test capabilities into this platform, and demonstrate product quality through open ecosystem testing. Integrators can refer to the open source implementation of this platform and provide solutions for their commercial products. At the same time, the realization of this requirement can be combined with OVP's existing processes to accelerate the testing and certification of OVP NFV commercial products.
• Business Funding- The test task auto execution capability can reduce the labor costs in traditional NFV test process and the R & D costs of NFV commercial products, as well as shorten the benefit reaping period of new products, and improve test efficiency.

Owners (one of these should be the Assignee - use @ notation):

yangyan

Lei_Huang

Link to HLD/LLD (if any):

• Enhance VTP and CLI to support:

     1.Test instruments integration：

    (1) Test Case execution;

    (2) Test Case discovering and auto registration;

    (3) Robot profile integration

     2. VTP capability expansion:

    (1)Loading different test scripts and cases- Scenario Active Management ;

    (2)Flexible test process definition(Middle);

    (3)Test report customization

    (4) Profile HTTP API support

     3. Execution-Standard / Open source test case support

    (1) Enable ETSI NFV APIs conformance test cases in VTP;

    (2) Enable CNCF CNF conformance test case in VTP.

Dependency Relationships with Other Projects:

 Enhancement of VNFSDK, CLI

Project Impact (Test Only (TO), Code (C)):

VNFSDK (C) , CLI (C)

Support Status for each Affected Project (Supported (S); Partially Supported (P); Not Supported (N)):

S

Architecture review :  ONAPARC-585 

Integration Leads (use @ notation):

zhaoliping123

Test Criteria: https://wiki.onap.org/display/DW/Automatic+Testing+Requirements

Company Engagement:

 China Mobile, Huawei - both work for VNFSDK, CLI enhancement