==== Introduction ==== This page deals with several Matrix representations of the dependencies of Test projects towards feature/Installer projects. * **Cross Matrix Feature versus Test projects** shows the current cooperations feature-testing. * **Feature Project Matrix** shows the requests collected from [[https://etherpad.opnfv.org/p/testing_requests_for_b_release]] ==== Cross Matrix Feature versus Test Projects ==== ^ Feature Project ^ [[:bottlenecks|Bottlenecks]] ^ [[:opnfv_functional_testing|Functest]] ^ [[:platform_performance_benchmarking|Qtip]] ^ [[:characterize_vswitch_performance_for_telco_nfv_use_cases|VSPerf]] ^ [[:yardstick|Yardstick]] ^ [[storperf|StorPerf]] ^ | [[:copper|Copper]] | - | X | - | - | - | - | | [[:doctor|Doctor]] | - | X | - | - | - | - | | [[:escalator|Escalator]] | No need |||||| | [[:high_availability_for_opnfv|HA]] | - | - | - | - | X | - | | [[:ipv6_opnfv_project|Ipv6]] | - | - | - | - | X | - | | [[:movie|Movie]] | - | - | - | - | - | - | | [[:multisite|Multisite]] | - | - | - | - | - | - | | [[:nfv-kvm|NFV for KVM]] | - | - | - | - | X | - | | [[:onosfw|ONOSFW]] | - | X | - | - | - | - | | [[:ovsnfv|Open vSwitch for NFV]] | - | - | - | - | X | - | | [[ovno:project_proposal|OVNO]] | - | X | - | - | - | - | | Parser | - | - | - | - | - | - | | [[policytest:start|PolicyTest]] | - | X | - | - | - | - | | [[:prediction|Prediction]] | - | - | - | - | - | - | | [[:promise|Promise]] | - | X | - | - | - | - | | [[:resource_scheduler|Resource Scheduler]] | - | - | - | - | - | - | | [[:service_function_chaining|Service Function Chaining (SFC)]] | - | - | - | - | X | - | |[[collaborative_development_projects:opnfv_telco_kpi_monitoring|SFQM]] | - | - | - | - | - | - | | [[requirements_projects:openstack_based_vnf_forwarding_graph|VNFFG]] | - | - | - | - | X | - | |[[:sdnvpn|SDNVPN]] | - | - | - | - | X | - | |} ==== Cross Matrix Test projects versus Pharos labs ==== ^ Project ^ [[https://build.opnfv.org/ci/computer/opnfv-jump-2/|LF POD 2]] ^ [[https://build.opnfv.org/ci/computer/cmcc-build-01/|cmcc-build1]] ^ [[https://build.opnfv.org/ci/computer/dell-build/|dell-build]] ^ [[https://build.opnfv.org/ci/computer/ericsson-build/|E//-build]] ^ [[https://build.opnfv.org/ci/computer/huawei-build-1/| huwaei-build1]] ^[[https://build.opnfv.org/ci/computer/intelpod2-jumphost/|Intel POD2]] ^ [[https://build.opnfv.org/ci/computer/intel-jp3-3/|intel-jp3-3]] ^ [[https://build.opnfv.org/ci/computer/orange-test1/|orange-test1]] ^ [[https://build.opnfv.org/ci/computer/zte-build-1/|zte-build-1]] ^ | [[:copper|Copper]] | - | - | - | - | - | - | - | - | - | | [[:doctor|Doctor]] | - | - | - | - | - | - | - | - | - | | [[:escalator|Escalator]] | - | - | - | - | - | - | - | - | - | | [[:high_availability_for_opnfv|HA]] | - | - | - | - | - | - | - | - | - | | [[:ipv6_opnfv_project|Ipv6]] | - | - | - | - | - | - | - | - | - | | [[:movie|Movie]] | - | - | - | - | - | - | - | - | - | | [[:multisite|Multisite]] | - | - | - | - | - | - | - | - | - | | [[:nfv-kvm|NFV for KVM]] | - | - | - | - | - | - | - | - | - | | [[:onosfw|ONOSFW]] | - | - | - | - | - | - | - | - | - | | [[:ovsnfv|Open vSwitch for NFV]] | - | - | - | - | - | - | - | - | - | | [[ovno:project_proposal|OVNO]] | - | - | - | - | - | - | - | - | - | | Parser | - | - | - | - | - | - | - | - | - | | [[policytest:start|PolicyTest]] | - | - | - | - | - | - | - | - | - | | [[:prediction|Prediction]] | - | - | - | - | - | - | - | - | - | | [[:promise|Promise]] | - | - | - | - | - | - | - | - | - | | [[:resource_scheduler|Resource Scheduler]] | - | - | - | - | - | - | - | - | - | | [[:service_function_chaining|Service Function Chaining (SFC)]] | - | - | - | - | - | - | - | - | - | |[[collaborative_development_projects:opnfv_telco_kpi_monitoring|SFQM]] | - | - | - | - | - | - | - | - | - | | [[requirements_projects:openstack_based_vnf_forwarding_graph|VNFFG]] | - | - | - | - | - | - | - | - | - | |[[:sdnvpn|SDNVPN]] | - | - | - | - | - | - | - | - | - | |[[:bottlenecks|Bottlenecks]] | - | - | - | - | - | - | - | - | - | |[[:opnfv_functional_testing|Functest]] | X | - | - | - | - | X | - | X | - | |[[:platform_performance_benchmarking|Qtip]] | - | - | - | - | - | - | - | - | - | |[[:characterize_vswitch_performance_for_telco_nfv_use_cases|VSPerf]] | - | - | - | - | - | - | - | - | - | |[[:yardstick|Yardstick]] | X | X | - | X | X | - | - | - | X | |[[storperf|StorPerf]] | - | - | - | - | - | - | - | - | - | |} ==== Feature Project Matrix ==== ^ Project Name ^ Category ^ Component ^ Domain ^ Description ^ Environment ^ Tooling ^ Code ref point ^ | [[:copper|Copper]] | System-level functional testing, Performance | OpenStack (Congress), ODL | VIM | Functional and Performance Test of Virtualized Infrastructure Deployment Policy Management | Installed components per Copper requirements on Genesis (see https://jira.opnfv.org/browse/GENESIS-54?jql=project%20%3D%20GENESIS)| Functest | | | [[:doctor|Doctor]] | System-level Functional Testing | OpenStack (Ceilometer, Heat) | Compute | Functional testing of Doctor framework | no prefernce for distro, but prefer Heat and Zabbix to be installed (preference of Zabbix is under discussion in doctor team) | Funtest | | | [[:escalator|Escalator]] | no test requirements for B release ||||||| | [[:high_availability_for_opnfv|HA]] | ????? ||||||| | [[:ipv6_opnfv_project|Ipv6]] | System-level Functional Testing (from a User/VNF perspective) | VNF OpenStack ODL | Network (Virtual) | Functional Test of a Working IPv6 Environment based on IPv6 vRouter on a Service VM | Test Pre-requisites: \\ * external IPv6 router (SLAAC), and one physical NIC that is connected to external IPv6 network \\ * All installation has been done as usual in B Release. Usual functest starts. \\ * Test script spawns Service VM and configures it using metadata \\ * Ping6 verifies upstream default gateway \\ NMAP discovers neighbors in the same subnet \\ * HTTP GET accesses external server: e.g. http://test-ipv6.com/ | | | | ARMBAND | OAM (Installation), and System-level Functional Testing (from a User/VNF perspective) | VNF OpenStack ODL KVM | Compute Storage Network, all are on ARM Hardware + Virtual | Functional Test of installation, configuration and working OPNFV deployment on ARM hardware | Fuel installer + Ubuntu 14.04 + Cavium hardware | | | | [[:movie|Movie]] | ????? ||||||| | [[:multisite|Multisite]] | ????? ||||||| | [[:nfv-kvm|NFV for KVM]] | ????? ||||||| | [[:onosfw|ONOSFW]] | ????? ||||||| | [[:ovsnfv|Open vSwitch for NFV]] | ????? ||||||| | [[documentation:opnfvdocs|opnfvdocs]] | ????? ||||||| | [[ovno:project_proposal|OVNO]] | System-level Functional Testing | OpenStack+OpenContrail extensions | Network | Functional testing of virutal networking - Networks, policies, SFC | Fuel, JOID, Apex (maybe Compass) \\ Test tools used/planned: Scripts running python interface to OpenStack and OpenContrail to be integrated into Functest environment \\ Pointer to test code and test integration code (for CI) - TBD | Functest | | | Parser | ????? ||||||| | [[policytest:start|PolicyTest]] | ????? - assume it is a test and not a feature project? ||||||| | [[:prediction|Prediction]] | ????? ||||||| | [[:promise|Promise]] | System-level Functional Testing, Performance, Robustness | Promise+OpenStack | Compute+Network+Storage | Functional testing of Promise Resource Manager installation, configuration and operational verifications against target OpenStack instance | Node.js + Web Browser (or HTTP client such as curl) | Functest | | | [[:resource_scheduler|Resource Scheduler]] | ????? ||||||| | [[:service_function_chaining|Service Function Chaining (SFC)]] | ????? ||||||| | [[collaborative_development_projects:opnfv_telco_kpi_monitoring|SFQM]] | ????? ||||||| | [[requirements_projects:openstack_based_vnf_forwarding_graph|VNFFG]] | ????? ||||||| |}