User Tools

Site Tools


virtual_provider_edge

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
virtual_provider_edge [2014/11/16 00:05]
Palani Chinnakannan
virtual_provider_edge [2015/04/23 12:39] (current)
Morgan Richomme [Table]
Line 61: Line 61:
 The following table provides the performance tuning characteristics. Some of these characteristics are varied in the test cases to study the behavior of the OPNFV platform. This table requires a in depth review and ongoing updates to select the best performance tuning characteristics. The following table provides the performance tuning characteristics. Some of these characteristics are varied in the test cases to study the behavior of the OPNFV platform. This table requires a in depth review and ongoing updates to select the best performance tuning characteristics.
  
-^Entity ​ ^ Performance Tuning Characteristics ^ +^ Entity ​      ​^ Performance Tuning Characteristics ​                                                                                                     
-|Host CPU | Sandy bridge, host CPU,  sockets N, cores 1, threads 1, vCPU and IO Thread pinning, Automatic NUMA balancing, APICv, EOI Acceleration. | +| Host CPU     ​| Sandy bridge, host CPU,  sockets N, cores 1, threads 1, vCPU and IO Thread pinning, Automatic NUMA balancing, APICv, EOI Acceleration. ​ 
-|Memory | Balloon 50 %, hard_limit, soft_limit, swap_hard_limit,​ huge_pages| +| Memory ​      ​| Balloon 50 %, hard_limit, soft_limit, swap_hard_limit,​ huge_pages ​                                                                      ​
-|vNIC | Passthru, SR-IPV, vhost-net, multi-queue virtio-net, arp filter, MTU Size, Bridge zero copy transmit| +| vNIC         ​| Passthru, SR-IOV, vhost-net, multi-queue virtio-net, arp filter, MTU Size, Bridge zero copy transmit ​                                   
-|Queue sizes| Rx/Tx Queue sizes 32K| +| Queue sizes  | Rx/Tx Queue sizes 32K                                                                                                                   ​
-|disk | virtio scsi|+| disk         ​| virtio scsi                                                                                                                             ​| 
  
 ====== High Level Software Architecture ====== ====== High Level Software Architecture ======
Line 93: Line 94:
  == TODO ==  == TODO ==
  
-====== ​vPE Functional Testing =====+====== ​Generic ​Functional Testing =====
 The following table provides a list of high level functional test cases. We need to agree on the columns used and if we need to add any more columns. The following defines the column headers. The following table provides a list of high level functional test cases. We need to agree on the columns used and if we need to add any more columns. The following defines the column headers.
   * Test Id: Identifier for the Test and starts with a letter '​F'​ for functional and '​P'​ for performance. Contains a 3 digit test suite identifier followed by a 3 digit sub test suite or test case identifier. In case of sub test suite, a further 3 digit number identifies the test case.   * Test Id: Identifier for the Test and starts with a letter '​F'​ for functional and '​P'​ for performance. Contains a 3 digit test suite identifier followed by a 3 digit sub test suite or test case identifier. In case of sub test suite, a further 3 digit number identifies the test case.
Line 103: Line 104:
   * Automation Required: Defines if automation is a must or not.  If Automation is a must have required then providing a pointer to a wiki that automates this will be useful.   * Automation Required: Defines if automation is a must or not.  If Automation is a must have required then providing a pointer to a wiki that automates this will be useful.
  
-^Test Id    ^Title ​ ^Type   ​^Description/​Procedure ​  ​^Pass/Fail Criteria ​  ​^Target Release ​  ​^Automation Required ​ ^ +^ Test Id    ^ Title                                               ​^ Type   ^ Description/​Procedure ​                                                                                                                                                                                                                                                                                            ​^ Pass/Fail Criteria ​ ^ Target Release ​ ^ Automation Required ​ ^ 
-|[[F-001]] ​ |OPNFV Platform Cold System Install ​ |Suite ​ |A comprehensive test suite that covers all aspects of system installation to ensure that all components of the system is installed, configured and functioning properly. ​ | N/A  |R1.0  ​|Yes   ​+| [[F-001]] ​ | OPNFV Platform Cold System Install ​                 | Suite  | A comprehensive test suite that covers all aspects of system installation to ensure that all components of the system is installed, configured and functioning properly. ​                                                                                                                                         | N/A                 ​                ​| Yes                  
-|[[F-002]] ​  ​|OPNFV Platform Basic NFV Functions ​ |Suite ​ |A test suite to cover basic NFVI functionality testing like service Orchestration,​ basic  life cycle management and basic network functions (layer 2, layer 4 connectivity),​ addressing (v4/v6). Includes tenant workloads that can consume the NFV services. Includes protocol inter operability Multi-Tenancy. ​ |N/A  R1.0  ​|Yes  +| [[F-002]] ​ | OPNFV Platform Basic NFV Functions ​                 | Suite  | A test suite to cover basic NFVI functionality testing like service Orchestration,​ basic  life cycle management and basic network functions (layer 2, layer 4 connectivity),​ addressing (v4/v6). Includes tenant workloads that can consume the NFV services. Includes protocol inter operability Multi-Tenancy. ​ | N/A                 ​                ​| Yes                  
-|[[F-003]] ​ | OPNFV Platform PNF Connectivity ​  ​|Suite ​ |Test suite to test a VNF connectivity to PNF.  Covers a wide ranges of VNF to PNF connections. ​   | N/A   ​R1.0  ​|Yes   ​+| [[F-003]] ​ | OPNFV Platform PNF Connectivity ​                    ​| Suite  | Test suite to test a VNF connectivity to PNF.  Covers a wide ranges of VNF to PNF connections. ​                                                                                                                                                                                                                   | N/A                 ​                ​| Yes                  
-| [[F-004]] ​ | OPNFV Platform Basic Service Chaining ​  ​|Suite ​ |Test suite for testing service chains. Identifies a comprehensive suite of service chains. ​  ​|N/A   ​|R1.0    ​|Yes  |+| [[F-004]] ​ | OPNFV Platform Basic Service Chaining ​              ​| Suite  | Test suite for testing service chains. Identifies a comprehensive suite of service chains. ​                                                                                                                                                                                                                       | N/A                 ​                | Yes                  | 
 +| [[F-005]] ​ | OPNFV Platform, NFV Complete Life Cycle Management ​ | Suite  | Test suite to cover elastic scaling of the VNFs based on demand, HA, Faults handling, Service Upgrade etcResource allocation and management ​                                                                                                                                                                    | N/A                 ​| ​                | Yes                  | 
 +| [[F-006]] ​ | OPNFV Platform Fault Management ​                    | Suite  | Test Suite for covering all aspect of Fault monitoring, management, service assurance, service Resiliency etc.                                                                                                                                                                                                    | N/A                 ​| ​                | No                   | 
 +| [[F-007]] ​ | OPNFV Platform High Availability ​                   | Suite  | High Availability related tests. ​ Consider combining with above and call it FM and HA.                                                                                                                                                                                                                            | N/A                 ​| ​                | No                   |
  
-|[[F-005]] ​ |OPNFV Platform, NFV Complete Life Cycle Management ​ |Suite ​ | Test suite to cover elastic scaling of the VNFs based on demand, HA, Faults handling, Service Upgrade etc. Resource allocation and management | N/A   | R1.0  |Yes | + 
-|[[F-006]] ​  | OPNFV Platform Fault Management ​                    ​|Suite ​ |Test Suite for covering all aspect of Fault monitoring, management, service assurance, service Resiliency etc.  |N/A   |R1.0 |No  |                                 || + 
-|[[F-007]] ​ |OPNFV Platform High Availability ​                   |Suite ​ |High Availability related tests. ​ Consider combining with above and call it FM and HA.  |N/A    | R1.0   ​|No ​ |                                ||+====== vPE Functional Testing =====
  
 ^Test Id    ^Title ​ ^Type   ​^Description/​Procedure ​  ​^Pass/​Fail Criteria ​  ​^Target Release ​  ​^Automation Required ​  ^ ^Test Id    ^Title ​ ^Type   ​^Description/​Procedure ​  ​^Pass/​Fail Criteria ​  ​^Target Release ​  ​^Automation Required ​  ^
-|[[F-501]] ​ |Use Case: vPE Deployment ​                           |Suite ​ | A test suite that covers all aspects of a virtual provider edge functionality testing. This test suite covers a generic set of vPE functionality like using different routing protocols with the CE devices, mix of P and PE routers, different address families, features like QOS, ACL, etc.  | N/A                 ​| ​R1.0  ​|No  | +|[[F-501]] ​ |Use Case: vPE Deployment ​                           |Suite ​ | A test suite that covers all aspects of a virtual provider edge functionality testing. This test suite covers a generic set of vPE functionality like using different routing protocols with the CE devices, mix of P and PE routers, different address families, features like QOS, ACL, etc.  | N/A                 ​| ​  ​|No  | 
  
  
 +====== vPE Performance Testing =====
 +The vPE performance testing and measurement covers the following aspects of a vPE VNF deployment in an environment that simulates real traffic profiles:
 +  * Topology
 +  * Basic Traffic profiles
 +  * Advanced Traffic Profiles
  
 +===== Topology =====
 +The topology required for the performance measurement is specified above.
  
 +===== Basic Traffic profiles =====
  
 +===== Advanced Traffic profiles =====
  
-====== vPE Performance Testing ===== 
 The following table provides the test suites for the vPE performance testing. The following table provides the test suites for the vPE performance testing.
  
-^Test Id    ^Title ​ ^Type   ​^Description/​Procedure ​  ​^Pass/Fail Criteria ​  ​^Target Release ​  ​^Automation Required ​  ​+^ Test Id    ^ Title                                    ^ Type   ^ Description/​Procedure ​                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      ​^ Pass/Fail Criteria ​ ^ Target Release ​ ^ Automation Required ​ 
-|[[P-001]] ​ |vPE Control Plane Performance ​ |Suite ​ |The goal of this test suite is to study and measure the performance of the OPNFV platform components during vPE control plane setup and tear down that results from adding and deleting VPN sites, injecting/​withdrawing routes, setting up traffic QOS policies, enabling/​disabling BFD, interface flaps, triggering large route downloads etc.  |N/A  |R1.0  ​|No  +| [[P-001]] ​ | vPE Control Plane Performance ​           | Suite  | The goal of this test suite is to study and measure the performance of the OPNFV platform components during vPE control plane setup and tear down that results from adding and deleting VPN sites, injecting/​withdrawing routes, setting up traffic QOS policies, enabling/​disabling BFD, interface flaps, triggering large route downloads etc.                                                                                                                                                                                                                            | N/A                 ​                ​| No                   ​
-|[[P-002]] ​ |vPE Data plane performance ​ |Suite ​ |The goal of this test suite is to study and measure the performance of the OPNFV platform components during data forwarding under different load conditions of CEs, VPN sites. Each VPN site is designed to inject traffic that is specified in the following tables. In addition, the flows are subject to QOS treatment in a specified ratio for RT/AF/BE flows. In addition, a percentage of sites have BFD enabled at different polling intervals. Most of the traffic characteristic parameters like BFD period, traffic rate for RT, AF, BE flows, etc., are varied. |N/A  |R1.0  ​|No  +| [[P-002]] ​ | vPE Data plane performance ​              ​| Suite  | The goal of this test suite is to study and measure the performance of the OPNFV platform components during data forwarding under different load conditions of CEs, VPN sites. Each VPN site is designed to inject traffic that is specified in the following tables. In addition, the flows are subject to QOS treatment in a specified ratio for RT/AF/BE flows. In addition, a percentage of sites have BFD enabled at different polling intervals. Most of the traffic characteristic parameters like BFD period, traffic rate for RT, AF, BE flows, etc., are varied. ​ | N/A                 ​                ​| No                   ​
-|[[P-003]] ​ |vPE under control and data plane stress ​ |Suite ​ |This test suite combines the above two test suites in different proportions to study and measure the performance of the OPNFV platform under steady state data flow with control plane changes. ​ |N/A  |R1.0  ​|No  |+| [[P-003]] ​ | vPE under control and data plane stress ​ | Suite  | This test suite combines the above two test suites in different proportions to study and measure the performance of the OPNFV platform under steady state data flow with control plane changes. ​                                                                                                                                                                                                                                                                                                                                                                            ​| N/A                 ​                ​| No                   ​| 
  
virtual_provider_edge.1416096345.txt.gz · Last modified: 2014/11/16 00:05 by Palani Chinnakannan