Coverage by Domain
Testing category | Sub Category | OPNFV project | |
System-level functional testing | component | Functest | R1= Tempest + ODL + Rally |
Subsystem | | |
End to End | | |
from a user/VNF perspective | Yardstick / Functest | R1 = vPing |
Performance | Component | VPERF | for OVS |
Subsystem | Functest | R1= Rally for OpenStack |
End to End | Qtip / Yardstick | |
Security | Component | | |
Subsystem | | |
End to End | | |
Robustness | Component | | |
Subsystem | | |
End to End | Yardstick | |
OAM | installation | | |
patch | | |
upgrade | | |
backup & restore | | |
disaster recovery | | |
Reporting | Releng | |
Coverage by Component
In Arno BGS defined its content, we shall assume that each component is properly tested.
Component | OPNFV Project | Comments |
OpenStack | Functest | Rally is used to run Tempest suite as well as Rally benchs |
ODL | Functest | ODL OPNFV suite using Robotframework |
KVM | Yardstick | |
OVF | VPERF / Yardstick | |
Ceph | Functest / Yardstick | |
VNFs | Functest / Yardstick | vPing developed for Arno |
NIC | Qtip | |
Memory | Qtip / Yardstick | |
CPU | Qtip /Yardstick | |
Storage | Qtip / Yardstick | |
Coverage per ETSI domain
Domain | ŜubDomain | OPNFV project | Comments |
Compute | virtual | Yardstick | |
hardware | Yardstick | |
Storage | virtual | Yardstick | |
hardware | Yardstick | |
Network | virtual | VPERF / Yardstick | |
hardware | Yardstick | |
Virtualization layer | Yardstick | |
VIM | Functest / Yardstick | Tempest + Rally test suites |
Interfaces | Nf-Vi | | |
Vn-Nf | | |
Vl-HA | | |
Vl-HA | | |
Or-Vi | | |
Vi-Vnfm | | |
ETSI domains | vEPC | | |
vIMS | | |
Mobile base stations | | |
Fixed Access Network | | |
vHGW | | |
vCDNs | | |
Network Functions Virtualisation IaaS | | |
Virtual Network Function ‘aaS | Yardstick | infra verification for VTC, SFC, SDNVPN |
Virtual Network PaaS | | |
VNF Forwarding Graphs | | |
Coverage per .....