This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
| feature_test_project_matrix [2015/09/23 08:46] Morgan Richomme | feature_test_project_matrix [2015/10/29 16:55] (current) Morgan Richomme | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | |< 100% 50px - 5em 10em 10% >| | + | ==== Introduction ==== | 
| - | ^ project Name ^ Test Category  ^ Test component  ^ Test Domain  ^ Description  ^ Environment  ^ Test tooling  ^ Test code ref point ^ Associated test project  ^ Interested in Q&A  ^ | + | |
| - | | IPv6 | System-level Functional Testing (from a User/VNF perspective)  | VNF OpenStack ODL | Network (Virtual)  | Functional Test of a Working IPv6 Environment based on IPv6 vRouter on a Service VM | Pre-requisite: \\ * external IPv6 router (SLAAC), and one physical NIC that is connected to external IPv6 network \\ * All installation has been done as usual in B Release. Usual functest starts. \\ * Test script spawns Service VM and configures it using metadata \\ * Ping6 verifies upstream default gateway \\ NMAP discovers neighbors in the same subnet \\ * HTTP GET accesses external server: e.g. http://test-ipv6.com/ | |  | | yes | | + | |
| - | | ARM Band | OAM (Installation), and System-level Functional Testing (from a User/VNF perspective)  | VNF OpenStack ODL KVM | Compute Storage Network, all are on ARM Hardware + Virtual  | Functional Test of installation, configuration and working OPNFV deployment on ARM hardware  | Fuel installer + Ubuntu 14.04 + Cavium hardware  | |  | | | | + | |
| + | This page deals with several Matrix representations of the dependencies of Test projects towards feature/Installer projects. | ||
| + | * **Cross Matrix Feature versus Test projects** shows the current cooperations feature-testing. | ||
| + | * **Feature Project Matrix** shows the requests collected from [[https://etherpad.opnfv.org/p/testing_requests_for_b_release]] | ||
| + | ==== Cross Matrix Feature versus Test Projects ==== | ||
| - | + | ^ Feature Project ^ [[:bottlenecks|Bottlenecks]] ^ [[:opnfv_functional_testing|Functest]]  ^ [[:platform_performance_benchmarking|Qtip]]  ^ [[:characterize_vswitch_performance_for_telco_nfv_use_cases|VSPerf]] ^ [[:yardstick|Yardstick]] ^ [[storperf|StorPerf]] ^ | |
| + | | [[:copper|Copper]]  | - | X | - | - | - | - | | ||
| + | | [[:doctor|Doctor]]  | - | X | - | - | - | - | | ||
| + | | [[:escalator|Escalator]] | No need ||||||  | ||
| + | | [[:high_availability_for_opnfv|HA]] | - | - | - | - | X | - | | ||
| + | | [[:ipv6_opnfv_project|Ipv6]] | - | - | - | - | X | - | | ||
| + | | [[:movie|Movie]] | - | - | - | - | - | - | | ||
| + | | [[:multisite|Multisite]] | - | - | - | - | - | - | | ||
| + | | [[:nfv-kvm|NFV for KVM]] | - | - | - | - | X | - | | ||
| + | | [[:onosfw|ONOSFW]] | - | X | - | - | - | - | | ||
| + | | [[:ovsnfv|Open vSwitch for NFV]] | - | - | - | - | X | - | | ||
| + | | [[ovno:project_proposal|OVNO]] | - | X | - | - | - | - | | ||
| + | | Parser | - | - | - | - | - | - | | ||
| + | | [[policytest:start|PolicyTest]] | - | X | - | - | - | - | | ||
| + | | [[:prediction|Prediction]] | - | - | - | - | - | - | | ||
| + | | [[:promise|Promise]] | - | X | - | - | - | - | | ||
| + | | [[:resource_scheduler|Resource Scheduler]] | - | - | - | - | - | - | | ||
| + | | [[:service_function_chaining|Service Function Chaining (SFC)]] | - | - | - | - | X | - | | ||
| + | |[[collaborative_development_projects:opnfv_telco_kpi_monitoring|SFQM]] | - | - | - | - | - | - | | ||
| + | | [[requirements_projects:openstack_based_vnf_forwarding_graph|VNFFG]] | - | - | - | - | X | - | | ||
| + | |[[:sdnvpn|SDNVPN]] | - | - | - | - | X | - | | ||
| + | |||
| + | |} | ||
| + | |||
| + | ==== Cross Matrix Test projects versus Pharos labs ==== | ||
| + | |||
| + | ^ Project ^ [[https://build.opnfv.org/ci/computer/opnfv-jump-2/|LF POD 2]] ^ [[https://build.opnfv.org/ci/computer/cmcc-build-01/|cmcc-build1]] ^ [[https://build.opnfv.org/ci/computer/dell-build/|dell-build]] ^ [[https://build.opnfv.org/ci/computer/ericsson-build/|E//-build]] ^ [[https://build.opnfv.org/ci/computer/huawei-build-1/| huwaei-build1]] ^[[https://build.opnfv.org/ci/computer/intelpod2-jumphost/|Intel POD2]] ^ [[https://build.opnfv.org/ci/computer/intel-jp3-3/|intel-jp3-3]] ^ [[https://build.opnfv.org/ci/computer/orange-test1/|orange-test1]] ^ [[https://build.opnfv.org/ci/computer/zte-build-1/|zte-build-1]] ^ | ||
| + | | [[:copper|Copper]]  | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[:doctor|Doctor]]  | - | - | - | - | - | - | - | - | - | | ||
| + | | [[:escalator|Escalator]] | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[:high_availability_for_opnfv|HA]] | - | - | - | - | - | - | - | - | - | | ||
| + | | [[:ipv6_opnfv_project|Ipv6]] | - | - | - | - | - | - | - | - | - | | ||
| + | | [[:movie|Movie]] | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[:multisite|Multisite]] | - | - | - | - | - | - | - | - | - | | ||
| + | | [[:nfv-kvm|NFV for KVM]] | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[:onosfw|ONOSFW]] | - | - | - | - | - | - | - | - | - | | ||
| + | | [[:ovsnfv|Open vSwitch for NFV]] | - | - | - | - | - | - | - | - | - | | ||
| + | | [[ovno:project_proposal|OVNO]] | - | - | - | - | - | - | - | - | - | | ||
| + | | Parser | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[policytest:start|PolicyTest]] | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[:prediction|Prediction]] | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[:promise|Promise]] | - | - | - | - | - | - | - | - | - | | ||
| + | | [[:resource_scheduler|Resource Scheduler]] | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[:service_function_chaining|Service Function Chaining (SFC)]] | - | - | - | - | - | - | - | - | - | | ||
| + | |[[collaborative_development_projects:opnfv_telco_kpi_monitoring|SFQM]] | - | - | - | - | - | - | - | - | - |  | ||
| + | | [[requirements_projects:openstack_based_vnf_forwarding_graph|VNFFG]] | - | - | - | - | - | - | - | - | - | | ||
| + | |[[:sdnvpn|SDNVPN]] | - | - | - | - | - | - | - | - | - |  | ||
| + | |[[:bottlenecks|Bottlenecks]] | - | - | - | - | - | - | - | - | - |  | ||
| + | |[[:opnfv_functional_testing|Functest]] | X | - | - | - | - | X | - | X | - |  | ||
| + | |[[:platform_performance_benchmarking|Qtip]] | - | - | - | - | - | - | - | - | - |  | ||
| + | |[[:characterize_vswitch_performance_for_telco_nfv_use_cases|VSPerf]] | - | - | - | - | - | - | - | - | - |  | ||
| + | |[[:yardstick|Yardstick]] | X | X | - | X | X | - | - | - | X |  | ||
| + | |[[storperf|StorPerf]] | - | - | - | - | - | - | - | - | - |  | ||
| + | |} | ||
| + | |||
| + | |||
| + | ==== Feature Project Matrix ==== | ||
| + | |||
| + | |||
| + | ^ Project Name ^ Category  ^ Component  ^ Domain  ^ Description  ^ Environment  ^ Tooling  ^ Code ref point ^ | ||
| + | | [[:copper|Copper]] | System-level functional testing, Performance | OpenStack (Congress), ODL | VIM | Functional and Performance Test of Virtualized Infrastructure Deployment Policy Management  | Installed components per Copper requirements on Genesis (see https://jira.opnfv.org/browse/GENESIS-54?jql=project%20%3D%20GENESIS)| Functest | | | ||
| + | | [[:doctor|Doctor]] | System-level Functional Testing | OpenStack (Ceilometer, Heat) | Compute | Functional testing of Doctor framework | no prefernce for distro, but prefer Heat and Zabbix to be installed (preference of Zabbix is under discussion in doctor team) | Funtest | | | ||
| + | | [[:escalator|Escalator]]  | no test requirements for B release ||||||| | ||
| + | | [[:high_availability_for_opnfv|HA]] | ????? ||||||| | ||
| + | | [[:ipv6_opnfv_project|Ipv6]]  | System-level Functional Testing (from a User/VNF perspective)  | VNF OpenStack ODL | Network (Virtual)  | Functional Test of a Working IPv6 Environment based on IPv6 vRouter on a Service VM | Test Pre-requisites: \\ * external IPv6 router (SLAAC), and one physical NIC that is connected to external IPv6 network \\ * All installation has been done as usual in B Release. Usual functest starts. \\ * Test script spawns Service VM and configures it using metadata \\ * Ping6 verifies upstream default gateway \\ NMAP discovers neighbors in the same subnet \\ * HTTP GET accesses external server: e.g. http://test-ipv6.com/ | |  | | ||
| + | | ARMBAND  | OAM (Installation), and System-level Functional Testing (from a User/VNF perspective)  | VNF OpenStack ODL KVM | Compute Storage Network, all are on ARM Hardware + Virtual  | Functional Test of installation, configuration and working OPNFV deployment on ARM hardware  | Fuel installer + Ubuntu 14.04 + Cavium hardware | | |  | ||
| + | | [[:movie|Movie]] | ????? |||||||   | ||
| + | | [[:multisite|Multisite]] | ????? |||||||   | ||
| + | | [[:nfv-kvm|NFV for KVM]] | ????? |||||||  | ||
| + | | [[:onosfw|ONOSFW]] | ????? ||||||| | ||
| + | | [[:ovsnfv|Open vSwitch for NFV]] | ????? ||||||| | ||
| + | | [[documentation:opnfvdocs|opnfvdocs]] | ????? ||||||| | ||
| + | | [[ovno:project_proposal|OVNO]] | System-level Functional Testing | OpenStack+OpenContrail extensions | Network | Functional testing of virutal networking - Networks, policies, SFC | Fuel, JOID, Apex (maybe Compass) \\ Test tools used/planned: Scripts running python interface to OpenStack and OpenContrail to be integrated into Functest environment \\ Pointer to test code and test integration code (for CI) - TBD | Functest | | | ||
| + | | Parser  | ????? ||||||| | ||
| + | | [[policytest:start|PolicyTest]] | ????? - assume it is a test and not a feature project? |||||||  | ||
| + | | [[:prediction|Prediction]] | ????? |||||||   | ||
| + | | [[:promise|Promise]] | System-level Functional Testing, Performance, Robustness | Promise+OpenStack | Compute+Network+Storage | Functional testing of Promise Resource Manager installation, configuration and operational verifications against target OpenStack instance | Node.js + Web Browser (or HTTP client such as curl) | Functest | | | ||
| + | | [[:resource_scheduler|Resource Scheduler]]  | ????? ||||||| | ||
| + | | [[:service_function_chaining|Service Function Chaining (SFC)]]  | ????? |||||||  | ||
| + | | [[collaborative_development_projects:opnfv_telco_kpi_monitoring|SFQM]] | ????? ||||||| | ||
| + | | [[requirements_projects:openstack_based_vnf_forwarding_graph|VNFFG]]  | ????? ||||||| | ||
| + | |} | ||