| Testing category | Sub Category | OPNFV project | |
|---|---|---|---|
| System-level functional testing | component | Functest | R1= Tempest + ODL + Rally |
| Subsystem | |||
| End to End | |||
| from a user/VNF perspective | Yardstick / Functest | R1 = vPing | |
| Performance | Component | VPERF | for OVS |
| Subsystem | Functest | R1= Rally for OpenStack | |
| End to End | Qtip / Yardstick | ||
| Security | Component | ||
| Subsystem | |||
| End to End | |||
| Robustness | Component | ||
| Subsystem | |||
| End to End | Yardstick | ||
| OAM | installation | ||
| patch | |||
| upgrade | |||
| backup & restore | |||
| disaster recovery | |||
| Reporting | Releng | ||
In Arno BGS defined its content, we shall assume that each component is properly tested.
| Component | OPNFV Project | Comments |
|---|---|---|
| OpenStack | Functest | Rally is used to run Tempest suite as well as Rally benchs |
| ODL | Functest | ODL OPNFV suite using Robotframework |
| KVM | Yardstick | |
| OVF | VPERF / Yardstick | |
| Ceph | Functest / Yardstick | |
| VNFs | Functest / Yardstick | vPing developed for Arno |
| NIC | Qtip | |
| Memory | Qtip / Yardstick | |
| CPU | Qtip /Yardstick | |
| Storage | Qtip / Yardstick |
| Domain | ŜubDomain | OPNFV project | Comments |
|---|---|---|---|
| Compute | virtual | Yardstick | |
| hardware | Yardstick | ||
| Storage | virtual | Yardstick | |
| hardware | Yardstick | ||
| Network | virtual | VPERF / Yardstick | |
| hardware | Yardstick | ||
| Virtualization layer | Yardstick | ||
| VIM | Functest / Yardstick | Tempest + Rally test suites | |
| Interfaces | Nf-Vi | ||
| Vn-Nf | |||
| Vl-HA | |||
| Vl-HA | |||
| Or-Vi | |||
| Vi-Vnfm | |||
| ETSI domains | vEPC | ||
| vIMS | |||
| Mobile base stations | |||
| Fixed Access Network | |||
| vHGW | |||
| vCDNs | |||
| Network Functions Virtualisation IaaS | |||
| Virtual Network Function ‘aaS | Yardstick | infra verification for VTC, SFC, SDNVPN | |
| Virtual Network PaaS | |||
| VNF Forwarding Graphs | |||