User Tools

Site Tools


feature_test_project_matrix

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
feature_test_project_matrix [2015/09/23 08:08]
Morgan Richomme [Table]
feature_test_project_matrix [2015/10/29 16:55] (current)
Morgan Richomme
Line 1: Line 1:
-|< 100% 50px - 5em 10em 10% >| +==== Introduction ====
-^ project Name  ^ Test Category ​                                                                         ^ Test component ​        ^ Test Domain ​                                                ^ Description ​                                                                                 ^ Environment ​                                                                                                                                                                                                                                                                                                                                                                                                                 ^ Test tooling ​ ^ Test code ref point  ^ Associated test project ​ ^ Interested in Q&​A ​ ^ +
-| IPv6          | System-level Functional Testing (from a User/VNF perspective) ​                         | VNF OpenStack ODL      | Network (Virtual) ​                                          | Functional Test of a Working IPv6 Environment based on IPv6 vRouter on a Service VM          |  - Pre-requisite:​ external IPv6 router (SLAAC), and one physical NIC that is connected to external IPv6 network** All installation has been done as usual in B Release. Usual functest starts. \* Test script spawns Service VM and configures it using metadata \* Ping6 verifies upstream default gateway \ * NMAP discovers neighbors in the same subnet \* HTTP GET accesses external server: e.g. http://​test-ipv6.com/​ |               ​| ​                     |                          | yes                | +
-| ARM Band      | OAM (Installation),​ and System-level Functional Testing (from a User/VNF perspective) ​ |  VNF OpenStack ODL KVM | Compute Storage Network, all are on ARM Hardware + Virtual ​ | Functional Test of installation,​ configuration and working OPNFV deployment on ARM hardware ​ | Fuel installer + Ubuntu 14.04 + Cavium hardware ​                                                                                                                                                                                                                                                                                                                                                                             |               ​| ​                     |                          |                    |+
  
 +This page deals with several Matrix representations of the dependencies of Test projects towards feature/​Installer projects.
  
 +  * **Cross Matrix Feature versus Test projects** shows the current cooperations feature-testing.
 +  * **Feature Project Matrix** shows the requests collected from [[https://​etherpad.opnfv.org/​p/​testing_requests_for_b_release]]
  
  
 +==== Cross Matrix Feature versus Test Projects ====
  
- +^ Feature Project ^ [[:​bottlenecks|Bottlenecks]] ^ [[:​opnfv_functional_testing|Functest]] ​ ^ [[:​platform_performance_benchmarking|Qtip]] ​ ^ [[:​characterize_vswitch_performance_for_telco_nfv_use_cases|VSPerf]] ^ [[:​yardstick|Yardstick]] ^ [[storperf|StorPerf]] ^ 
 +| [[:​copper|Copper]] ​  | - | X | -  | - | -  | - |       
 +| [[:​doctor|Doctor]] ​  | - | X | - | - | - |  - | 
 +| [[:​escalator|Escalator]] | No need |||||| ​                        
 +| [[:​high_availability_for_opnfv|HA]] | - | - | - |  - | X | - | 
 +| [[:​ipv6_opnfv_project|Ipv6]] | - | - | - |  - | X | - |      
 +| [[:​movie|Movie]] | - | - | - | - | - |  - |                     
 +| [[:​multisite|Multisite]] | - | - | - |  - | - | - |            
 +| [[:​nfv-kvm|NFV for KVM]] | - | - | - |  - | X | - |             
 +| [[:​onosfw|ONOSFW]] | - | X | - | - | - |  - |      
 +| [[:​ovsnfv|Open vSwitch for NFV]] | - | - |  - | - | X | - |  
 +| [[ovno:​project_proposal|OVNO]] | - | X | - |  - | - | - | 
 +| Parser | - | - | - | - | - | - |                       
 +| [[policytest:​start|PolicyTest]] | - | X | - | - | - | - |   
 +| [[:​prediction|Prediction]] | - | - | - | - | - | - |             
 +| [[:​promise|Promise]] | - | X | - | - | - | - |              
 +| [[:​resource_scheduler|Resource Scheduler]] | - | - | - | - | - | - |                 
 +| [[:​service_function_chaining|Service Function Chaining (SFC)]] | - | - |  - | - | X | - | 
 +|[[collaborative_development_projects:​opnfv_telco_kpi_monitoring|SFQM]] |  - | - | - | - | - | - |   
 +| [[requirements_projects:​openstack_based_vnf_forwarding_graph|VNFFG]] |  - | - | - | - | X | - | 
 +|[[:​sdnvpn|SDNVPN]] | - | - | - | - | X | - |   
 +          
 +|}
  
 +
 +==== Cross Matrix Test projects versus Pharos labs ====
 +
 +^ Project ^ [[https://​build.opnfv.org/​ci/​computer/​opnfv-jump-2/​|LF POD 2]] ^ [[https://​build.opnfv.org/​ci/​computer/​cmcc-build-01/​|cmcc-build1]] ^  [[https://​build.opnfv.org/​ci/​computer/​dell-build/​|dell-build]] ^ [[https://​build.opnfv.org/​ci/​computer/​ericsson-build/​|E//​-build]] ^ [[https://​build.opnfv.org/​ci/​computer/​huawei-build-1/​| huwaei-build1]] ^[[https://​build.opnfv.org/​ci/​computer/​intelpod2-jumphost/​|Intel POD2]] ^ [[https://​build.opnfv.org/​ci/​computer/​intel-jp3-3/​|intel-jp3-3]] ^ [[https://​build.opnfv.org/​ci/​computer/​orange-test1/​|orange-test1]] ^ [[https://​build.opnfv.org/​ci/​computer/​zte-build-1/​|zte-build-1]] ^
 +| [[:​copper|Copper]] ​  | - | - | - | - | - | - | - | - | - |      ​
 +| [[:​doctor|Doctor]] ​  | - | - | - | - | - | - | - | - | - |
 +| [[:​escalator|Escalator]] | - | - | - | - | - | - | - | - | - |                        ​
 +| [[:​high_availability_for_opnfv|HA]] | - | - | - | - | - | - | - | - | - |
 +| [[:​ipv6_opnfv_project|Ipv6]] | - | - | - | - | - | - | - | - | - |     
 +| [[:​movie|Movie]] | - | - | - | - | - | - | - | - | - |                    ​
 +| [[:​multisite|Multisite]] | - | - | - | - | - | - | - | - | - |     
 +| [[:​nfv-kvm|NFV for KVM]] | - | - | - | - | - | - | - | - | - |        ​
 +| [[:​onosfw|ONOSFW]] | - | - | - | - | - | - | - | - | - |     
 +| [[:​ovsnfv|Open vSwitch for NFV]] | - | - | - | - | - | - | - | - | - | 
 +| [[ovno:​project_proposal|OVNO]] | - | - | - | - | - | - | - | - | - |
 +| Parser | - | - | - | - | - | - | - | - | - |                      ​
 +| [[policytest:​start|PolicyTest]] | - | - | - | - | - | - | - | - | - |  ​
 +| [[:​prediction|Prediction]] | - | - | - | - | - | - | - | - | - |            ​
 +| [[:​promise|Promise]] | - | - | - | - | - | - | - | - | - |             
 +| [[:​resource_scheduler|Resource Scheduler]] | - | - | - | - | - | - | - | - | - |                ​
 +| [[:​service_function_chaining|Service Function Chaining (SFC)]] | - | - | - | - | - | - | - | - | - |
 +|[[collaborative_development_projects:​opnfv_telco_kpi_monitoring|SFQM]] | - | - | - | - | - | - | - | - | - |  ​
 +| [[requirements_projects:​openstack_based_vnf_forwarding_graph|VNFFG]] | - | - | - | - | - | - | - | - | - |
 +|[[:​sdnvpn|SDNVPN]] | - | - | - | - | - | - | - | - | - |  ​
 +|[[:​bottlenecks|Bottlenecks]] | - | - | - | - | - | - | - | - | - |  ​
 +|[[:​opnfv_functional_testing|Functest]] | X | - | - | - | - | X | - | X | - |  ​
 +|[[:​platform_performance_benchmarking|Qtip]] | - | - | - | - | - | - | - | - | - |  ​
 +|[[:​characterize_vswitch_performance_for_telco_nfv_use_cases|VSPerf]] | - | - | - | - | - | - | - | - | - |  ​
 +|[[:​yardstick|Yardstick]] | X | X | - | X | X | - | - | - | X |  ​
 +|[[storperf|StorPerf]] | - | - | - | - | - | - | - | - | - |  ​
 +|}
 +
 +
 +==== Feature Project Matrix ====
 +
 +
 +^ Project Name  ^ Category ​                                                                         ^ Component ​        ^ Domain ​                                                ^ Description ​                                                                                 ^  Environment ​                                                                                           ^ Tooling ​ ^ Code ref point   ^
 +| [[:​copper|Copper]] | System-level functional testing, Performance | OpenStack (Congress), ODL | VIM | Functional and Performance Test of Virtualized Infrastructure Deployment Policy Management ​ | Installed components per Copper requirements on Genesis (see https://​jira.opnfv.org/​browse/​GENESIS-54?​jql=project%20%3D%20GENESIS)| Functest | | 
 +| [[:​doctor|Doctor]] | System-level Functional Testing | OpenStack (Ceilometer,​ Heat) | Compute | Functional testing of Doctor framework | no prefernce for distro, but prefer Heat and Zabbix to be installed (preference of Zabbix is under discussion in doctor team) | Funtest | |
 +| [[:​escalator|Escalator]] ​ | no test requirements for B release |||||||
 +| [[:​high_availability_for_opnfv|HA]] | ????? |||||||
 +| [[:​ipv6_opnfv_project|Ipv6]] ​         | System-level Functional Testing (from a User/VNF perspective) ​                         | VNF OpenStack ODL      | Network (Virtual) ​                                          | Functional Test of a Working IPv6 Environment based on IPv6 vRouter on a Service VM          | Test Pre-requisites:​ \\ * external IPv6 router (SLAAC), and one physical NIC that is connected to external IPv6 network \\ * All installation has been done as usual in B Release. Usual functest starts. \\ * Test script spawns Service VM and configures it using metadata \\ * Ping6 verifies upstream default gateway \\ NMAP discovers neighbors in the same subnet \\ * HTTP GET accesses external server: e.g. http://​test-ipv6.com/​ |               ​| ​                                     |
 +| ARMBAND ​     | OAM (Installation),​ and System-level Functional Testing (from a User/VNF perspective) ​ |  VNF OpenStack ODL KVM | Compute Storage Network, all are on ARM Hardware + Virtual ​ | Functional Test of installation,​ configuration and working OPNFV deployment on ARM hardware ​ | Fuel installer + Ubuntu 14.04 + Cavium hardware |   | |                      ​
 +| [[:​movie|Movie]] | ????? ||||||| ​       ​
 +| [[:​multisite|Multisite]] | ????? ||||||| ​         ​
 +| [[:​nfv-kvm|NFV for KVM]] | ????? ||||||| ​          
 +| [[:​onosfw|ONOSFW]] | ????? |||||||
 +| [[:​ovsnfv|Open vSwitch for NFV]] | ????? |||||||
 +| [[documentation:​opnfvdocs|opnfvdocs]] | ????? |||||||
 +| [[ovno:​project_proposal|OVNO]] | System-level Functional Testing | OpenStack+OpenContrail extensions | Network | Functional testing of virutal networking - Networks, policies, SFC |  Fuel, JOID, Apex (maybe Compass) \\ Test tools used/​planned:​ Scripts running python interface to OpenStack and OpenContrail to be integrated into Functest environment \\ Pointer to test code and test integration code (for CI) - TBD |  Functest |  | 
 +| Parser ​                        | ????? |||||||
 +| [[policytest:​start|PolicyTest]] | ????? - assume it is a test and not a feature project? ||||||| ​
 +| [[:​prediction|Prediction]] | ????? ||||||| ​           ​
 +| [[:​promise|Promise]] |  System-level Functional Testing, Performance,​ Robustness | Promise+OpenStack | Compute+Network+Storage | Functional testing of Promise Resource Manager installation,​ configuration and operational verifications against target OpenStack instance | Node.js + Web Browser (or HTTP client such as curl) | Functest | |                                                 
 +| [[:​resource_scheduler|Resource Scheduler]] ​ | ????? |||||||
 +| [[:​service_function_chaining|Service Function Chaining (SFC)]] ​  | ????? ||||||| ​
 +| [[collaborative_development_projects:​opnfv_telco_kpi_monitoring|SFQM]] | ????? |||||||
 +| [[requirements_projects:​openstack_based_vnf_forwarding_graph|VNFFG]] ​ | ????? |||||||
 +|}
  
  
  
  
feature_test_project_matrix.1442995724.txt.gz · Last modified: 2015/09/23 08:08 by Morgan Richomme