User Tools

Site Tools


feature_test_project_matrix

Introduction

This page deals with several Matrix representations of the dependencies of Test projects towards feature/Installer projects.

Cross Matrix Feature versus Test Projects

Feature Project Bottlenecks Functest Qtip VSPerf Yardstick StorPerf
Copper - X - - - -
Doctor - X - - - -
Escalator No need
HA - - - - X -
Ipv6 - - - - X -
Movie - - - - - -
Multisite - - - - - -
NFV for KVM - - - - X -
ONOSFW - X - - - -
Open vSwitch for NFV - - - - X -
OVNO - X - - - -
Parser - - - - - -
PolicyTest - X - - - -
Prediction - - - - - -
Promise - X - - - -
Resource Scheduler - - - - - -
Service Function Chaining (SFC) - - - - X -
SFQM - - - - - -
VNFFG - - - - X -
SDNVPN - - - - X -

Cross Matrix Test projects versus Pharos labs

Project LF POD 2 cmcc-build1 dell-build E//-build huwaei-build1 Intel POD2 intel-jp3-3 orange-test1 zte-build-1
Copper - - - - - - - - -
Doctor - - - - - - - - -
Escalator - - - - - - - - -
HA - - - - - - - - -
Ipv6 - - - - - - - - -
Movie - - - - - - - - -
Multisite - - - - - - - - -
NFV for KVM - - - - - - - - -
ONOSFW - - - - - - - - -
Open vSwitch for NFV - - - - - - - - -
OVNO - - - - - - - - -
Parser - - - - - - - - -
PolicyTest - - - - - - - - -
Prediction - - - - - - - - -
Promise - - - - - - - - -
Resource Scheduler - - - - - - - - -
Service Function Chaining (SFC) - - - - - - - - -
SFQM - - - - - - - - -
VNFFG - - - - - - - - -
SDNVPN - - - - - - - - -
Bottlenecks - - - - - - - - -
Functest X - - - - X - X -
Qtip - - - - - - - - -
VSPerf - - - - - - - - -
Yardstick X X - X X - - - X
StorPerf - - - - - - - - -

Feature Project Matrix

Project Name Category Component Domain Description Environment Tooling Code ref point
Copper System-level functional testing, Performance OpenStack (Congress), ODL VIM Functional and Performance Test of Virtualized Infrastructure Deployment Policy Management Installed components per Copper requirements on Genesis (see https://jira.opnfv.org/browse/GENESIS-54?jql=project%20%3D%20GENESIS) Functest
Doctor System-level Functional Testing OpenStack (Ceilometer, Heat) Compute Functional testing of Doctor framework no prefernce for distro, but prefer Heat and Zabbix to be installed (preference of Zabbix is under discussion in doctor team) Funtest
Escalator no test requirements for B release
HA ?????
Ipv6 System-level Functional Testing (from a User/VNF perspective) VNF OpenStack ODL Network (Virtual) Functional Test of a Working IPv6 Environment based on IPv6 vRouter on a Service VM Test Pre-requisites:
* external IPv6 router (SLAAC), and one physical NIC that is connected to external IPv6 network
* All installation has been done as usual in B Release. Usual functest starts.
* Test script spawns Service VM and configures it using metadata
* Ping6 verifies upstream default gateway
NMAP discovers neighbors in the same subnet
* HTTP GET accesses external server: e.g. http://test-ipv6.com/
ARMBAND OAM (Installation), and System-level Functional Testing (from a User/VNF perspective) VNF OpenStack ODL KVM Compute Storage Network, all are on ARM Hardware + Virtual Functional Test of installation, configuration and working OPNFV deployment on ARM hardware Fuel installer + Ubuntu 14.04 + Cavium hardware
Movie ?????
Multisite ?????
NFV for KVM ?????
ONOSFW ?????
Open vSwitch for NFV ?????
opnfvdocs ?????
OVNO System-level Functional Testing OpenStack+OpenContrail extensions Network Functional testing of virutal networking - Networks, policies, SFC Fuel, JOID, Apex (maybe Compass)
Test tools used/planned: Scripts running python interface to OpenStack and OpenContrail to be integrated into Functest environment
Pointer to test code and test integration code (for CI) - TBD
Functest
Parser ?????
PolicyTest ????? - assume it is a test and not a feature project?
Prediction ?????
Promise System-level Functional Testing, Performance, Robustness Promise+OpenStack Compute+Network+Storage Functional testing of Promise Resource Manager installation, configuration and operational verifications against target OpenStack instance Node.js + Web Browser (or HTTP client such as curl) Functest
Resource Scheduler ?????
Service Function Chaining (SFC) ?????
SFQM ?????
VNFFG ?????
feature_test_project_matrix.txt · Last modified: 2015/10/29 16:55 by Morgan Richomme