=== Coverage by Domain === ^ Testing category ^ Sub Category ^OPNFV project ^Comments | System-level functional testing | component | Functest | R1= Tempest + ODL + Rally | | ::: | Subsystem | | | | ::: | End to End | | | | ::: | from a user/VNF perspective | Yardstick / Functest | R1 = vPing | | Performance | Component | VPERF | for OVS | | ::: | Subsystem | Functest | R1= Rally for OpenStack | | ::: | End to End | Qtip / Yardstick | | | Security | Component | | | | ::: | Subsystem | | | | ::: | End to End | | | | Robustness | Component | | | | ::: | Subsystem | | | | ::: | End to End | Yardstick | | | OAM | installation| | | | ::: | patch | | | | ::: | upgrade | | | | ::: | backup & restore | | | | ::: | disaster recovery | | | | Reporting || Releng | | === Coverage by Component === In Arno BGS defined its content, we shall assume that each component is properly tested. ^ Component ^ OPNFV Project ^ Comments ^ | OpenStack | Functest | Rally is used to run [[r1_tempest|Tempest]] suite as well as [[r1_rally_bench|Rally benchs]] | | ODL | Functest | [[r1_odl_suite|ODL OPNFV suite]] using Robotframework | | KVM | Yardstick | | | OVF | VPERF / Yardstick | | | Ceph | Functest / Yardstick | | | VNFs | Functest / Yardstick | [[r1_vping|vPing]] developed for Arno | | NIC | Qtip | | | Memory | Qtip / Yardstick | | | CPU | Qtip /Yardstick | | | Storage | Qtip / Yardstick | | === Coverage per ETSI domain === ^Domain ^ŜubDomain ^OPNFV project ^Comments ^ | Compute | virtual |Yardstick | | | ::: | hardware | Yardstick| | | Storage | virtual | Yardstick| | | ::: | hardware |Yardstick | | | Network | virtual | VPERF / Yardstick | | | ::: | hardware | Yardstick | | | Virtualization layer || Yardstick | | | VIM || Functest / Yardstick | Tempest + Rally test suites | | Interfaces | Nf-Vi | | | | ::: | Vn-Nf | | | | ::: | Vl-HA | | | | ::: | Vl-HA | | | | ::: | Or-Vi | | | | ::: | Vi-Vnfm | | | | ETSI domains | vEPC | | | | ::: | vIMS | | | | ::: | Mobile base stations | | | | ::: | Fixed Access Network | | | | ::: | vHGW | | | | ::: | vCDNs | | | | ::: | Network Functions Virtualisation IaaS | | | | ::: | Virtual Network Function ‘aaS | Yardstick |infra verification for VTC, SFC, SDNVPN | | ::: | Virtual Network PaaS | | | | ::: | VNF Forwarding Graphs | | | === Coverage per ..... ===