This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
virtual_provider_edge [2014/11/16 00:05] Palani Chinnakannan |
virtual_provider_edge [2015/04/23 12:38] Morgan Richomme [vPE Functional Testing] |
||
---|---|---|---|
Line 61: | Line 61: | ||
The following table provides the performance tuning characteristics. Some of these characteristics are varied in the test cases to study the behavior of the OPNFV platform. This table requires a in depth review and ongoing updates to select the best performance tuning characteristics. | The following table provides the performance tuning characteristics. Some of these characteristics are varied in the test cases to study the behavior of the OPNFV platform. This table requires a in depth review and ongoing updates to select the best performance tuning characteristics. | ||
- | ^Entity ^ Performance Tuning Characteristics ^ | + | ^ Entity ^ Performance Tuning Characteristics ^ |
- | |Host CPU | Sandy bridge, host CPU, sockets N, cores 1, threads 1, vCPU and IO Thread pinning, Automatic NUMA balancing, APICv, EOI Acceleration. | | + | | Host CPU | Sandy bridge, host CPU, sockets N, cores 1, threads 1, vCPU and IO Thread pinning, Automatic NUMA balancing, APICv, EOI Acceleration. | |
- | |Memory | Balloon 50 %, hard_limit, soft_limit, swap_hard_limit, huge_pages| | + | | Memory | Balloon 50 %, hard_limit, soft_limit, swap_hard_limit, huge_pages | |
- | |vNIC | Passthru, SR-IPV, vhost-net, multi-queue virtio-net, arp filter, MTU Size, Bridge zero copy transmit| | + | | vNIC | Passthru, SR-IOV, vhost-net, multi-queue virtio-net, arp filter, MTU Size, Bridge zero copy transmit | |
- | |Queue sizes| Rx/Tx Queue sizes 32K| | + | | Queue sizes | Rx/Tx Queue sizes 32K | |
- | |disk | virtio scsi| | + | | disk | virtio scsi | |
====== High Level Software Architecture ====== | ====== High Level Software Architecture ====== | ||
Line 93: | Line 94: | ||
== TODO == | == TODO == | ||
- | ====== vPE Functional Testing ===== | + | ====== Generic Functional Testing ===== |
The following table provides a list of high level functional test cases. We need to agree on the columns used and if we need to add any more columns. The following defines the column headers. | The following table provides a list of high level functional test cases. We need to agree on the columns used and if we need to add any more columns. The following defines the column headers. | ||
* Test Id: Identifier for the Test and starts with a letter 'F' for functional and 'P' for performance. Contains a 3 digit test suite identifier followed by a 3 digit sub test suite or test case identifier. In case of sub test suite, a further 3 digit number identifies the test case. | * Test Id: Identifier for the Test and starts with a letter 'F' for functional and 'P' for performance. Contains a 3 digit test suite identifier followed by a 3 digit sub test suite or test case identifier. In case of sub test suite, a further 3 digit number identifies the test case. | ||
Line 103: | Line 104: | ||
* Automation Required: Defines if automation is a must or not. If Automation is a must have required then providing a pointer to a wiki that automates this will be useful. | * Automation Required: Defines if automation is a must or not. If Automation is a must have required then providing a pointer to a wiki that automates this will be useful. | ||
- | ^Test Id ^Title ^Type ^Description/Procedure ^Pass/Fail Criteria ^Target Release ^Automation Required ^ | + | ^ Test Id ^ Title ^ Type ^ Description/Procedure ^ Pass/Fail Criteria ^ Target Release ^ Automation Required ^ |
- | |[[F-001]] |OPNFV Platform Cold System Install |Suite |A comprehensive test suite that covers all aspects of system installation to ensure that all components of the system is installed, configured and functioning properly. | N/A |R1.0 |Yes | | + | | [[F-001]] | OPNFV Platform Cold System Install | Suite | A comprehensive test suite that covers all aspects of system installation to ensure that all components of the system is installed, configured and functioning properly. | N/A | | Yes | |
- | |[[F-002]] |OPNFV Platform Basic NFV Functions |Suite |A test suite to cover basic NFVI functionality testing like service Orchestration, basic life cycle management and basic network functions (layer 2, layer 4 connectivity), addressing (v4/v6). Includes tenant workloads that can consume the NFV services. Includes protocol inter operability Multi-Tenancy. |N/A | R1.0 |Yes | | + | | [[F-002]] | OPNFV Platform Basic NFV Functions | Suite | A test suite to cover basic NFVI functionality testing like service Orchestration, basic life cycle management and basic network functions (layer 2, layer 4 connectivity), addressing (v4/v6). Includes tenant workloads that can consume the NFV services. Includes protocol inter operability Multi-Tenancy. | N/A | | Yes | |
- | |[[F-003]] | OPNFV Platform PNF Connectivity |Suite |Test suite to test a VNF connectivity to PNF. Covers a wide ranges of VNF to PNF connections. | N/A | R1.0 |Yes | | + | | [[F-003]] | OPNFV Platform PNF Connectivity | Suite | Test suite to test a VNF connectivity to PNF. Covers a wide ranges of VNF to PNF connections. | N/A | | Yes | |
- | | [[F-004]] | OPNFV Platform Basic Service Chaining |Suite |Test suite for testing service chains. Identifies a comprehensive suite of service chains. |N/A |R1.0 |Yes | | + | | [[F-004]] | OPNFV Platform Basic Service Chaining | Suite | Test suite for testing service chains. Identifies a comprehensive suite of service chains. | N/A | | Yes | |
+ | | [[F-005]] | OPNFV Platform, NFV Complete Life Cycle Management | Suite | Test suite to cover elastic scaling of the VNFs based on demand, HA, Faults handling, Service Upgrade etc. Resource allocation and management | N/A | | Yes | | ||
+ | | [[F-006]] | OPNFV Platform Fault Management | Suite | Test Suite for covering all aspect of Fault monitoring, management, service assurance, service Resiliency etc. | N/A | | No | | ||
+ | | [[F-007]] | OPNFV Platform High Availability | Suite | High Availability related tests. Consider combining with above and call it FM and HA. | N/A | | No | | ||
- | |[[F-005]] |OPNFV Platform, NFV Complete Life Cycle Management |Suite | Test suite to cover elastic scaling of the VNFs based on demand, HA, Faults handling, Service Upgrade etc. Resource allocation and management | N/A | R1.0 |Yes | | + | |
- | |[[F-006]] | OPNFV Platform Fault Management |Suite |Test Suite for covering all aspect of Fault monitoring, management, service assurance, service Resiliency etc. |N/A |R1.0 |No | || | + | |
- | |[[F-007]] |OPNFV Platform High Availability |Suite |High Availability related tests. Consider combining with above and call it FM and HA. |N/A | R1.0 |No | || | + | ====== vPE Functional Testing ===== |
^Test Id ^Title ^Type ^Description/Procedure ^Pass/Fail Criteria ^Target Release ^Automation Required ^ | ^Test Id ^Title ^Type ^Description/Procedure ^Pass/Fail Criteria ^Target Release ^Automation Required ^ | ||
- | |[[F-501]] |Use Case: vPE Deployment |Suite | A test suite that covers all aspects of a virtual provider edge functionality testing. This test suite covers a generic set of vPE functionality like using different routing protocols with the CE devices, mix of P and PE routers, different address families, features like QOS, ACL, etc. | N/A | R1.0 |No | | + | |[[F-501]] |Use Case: vPE Deployment |Suite | A test suite that covers all aspects of a virtual provider edge functionality testing. This test suite covers a generic set of vPE functionality like using different routing protocols with the CE devices, mix of P and PE routers, different address families, features like QOS, ACL, etc. | N/A | |No | |
+ | ====== vPE Performance Testing ===== | ||
+ | The vPE performance testing and measurement covers the following aspects of a vPE VNF deployment in an environment that simulates real traffic profiles: | ||
+ | * Topology | ||
+ | * Basic Traffic profiles | ||
+ | * Advanced Traffic Profiles | ||
+ | ===== Topology ===== | ||
+ | The topology required for the performance measurement is specified above. | ||
+ | ===== Basic Traffic profiles ===== | ||
+ | ===== Advanced Traffic profiles ===== | ||
- | ====== vPE Performance Testing ===== | ||
The following table provides the test suites for the vPE performance testing. | The following table provides the test suites for the vPE performance testing. | ||