This is an old revision of the document!
Project: OPNFV - Base system functionality testing (Functest)
Proposed name for the project: OPNFV – Base system functionality testing
Proposed name for the repository: functest
Project Categories: Integration & Testing
-
IRC chan: #opnfv-testperf
-
-
Project description
Project “OPNFV – Base system functionality testing” will provide comprehensive testing methodology, test suites and test cases to test and verify OPNFV Platform functionality that covers the VIM and NFVI components.
This project uses a "tops-down" approach that will start with chosen ETSI NFV use-case/s and open source VNFs for the functional testing. The approach taken will be to
break down the use-case into simple operations and functions required.
specify necessary network topologies
develop necessary test traffic and traffic profiles. Ideally VNFs will be Open Source however proprietary VNFs may also be used as needed.
This project will develop test suites that cover detailed functional test cases, test methodologies and platform configurations which will be documented and maintained in a repository for use by other OPNFV testing projects and the community in general. Developing test suites will also help lay the foundation for a test automation framework that in future can be used by the continuation integration (CI) project (Octopus). We envisage that certain VNF deployment use-cases could be automatically tested as an optional step of the CI process.
The project targets testing of the OPNFV platform in a hosted test-bed environment (i.e. using the OPNFV test labs world wide). It will leverage output of the "BGS" project.
The key objectives are:
A dedicated page for all the testing projects (Functest, Yardstick, Pharos, …) is available here.
Scope
“OPNFV – Base system functionality testing” will deliver a functional testing framework along with a set of test suites and test cases to test and verify the functionality OPNFV platform. The testing framework (tools, test-cases, etc.) are also intended to be used by the CI framework for the purpose of qualifying the OPNFV platform on bare metal servers. In this context, OPNFV Tester will use open source VNF components. Functional testing includes
Testing the basic VIM functionality that includes tenant, user CRUD operations, VNF Image CRUD operations etc.
Testing the VIM functionality to support VNF operations (create, modify, grow, shrink, destroy)
Testing the VIM functionality to support basic VNF network connectivity
Testing the inter working between the VIM and the SDN controller.
Testing the NFVI functionality as a black box to ensure that it meets the VIM requirements.
The project requires the following components:
OPNFV Lab setup with complete access to a set of Bare metal servers for Controller and Compute nodes (as defined by BGS project (OPNFV stack) and Pharos project (hardware)); associated switches and routers.
OPNFV platform software bundle from the repository that includes several upstream software components.
OPNFV "Bootstart Get Started!" software bundles that includes the installer
Rally (benchmark, Tempest)
-
Functional tests shall be
independant from the installer (Fuel, Foreman/Puppet, Juju,..)
automated and integrated in CI
Functest versus Release
Dependencies
The project is a contributor to project “Octopus”.
The project leverages "Boot Strap/Get Started"
The project relies on the following upstream projects:
OpenStack Juno release: Components: Nova, Glance, Keystone, Horizon, Neutron, Ceilometer, Heat
OpenDaylight Helium release: Components: MDSAL, OVSDB, RESTCONF, ML2 plugin/ODL Neutron drivers
Installer: TBD
Puppet (for instance configuration)
QEMU/KVM
OpenWRT (as example VNF - for routing, firewall, NAT)
Snort (as example VNF - for IDS)
Linux Ubuntu 14.04/Centos 7 distribution
Key Project Facts
This URL is not allowed for scraping
Additional Contributors
Frank Brockners (fbrockne@cisco.com)
Sajeev Manikkoth (sajeevmanikkoth@gmail.com)
Sean Chen (s.chen@huawei.com)
Rajeev Seth (rseth@sonusnet.com)
Kevin Riley (kriley@sonusnet.com)
Justin Hart (jhart@sonusnet.com)
Want to Join: know more on Functest
Planned deliverables
Project deliverable:
The project delivers the following components:
Documentation of Test Suites and test cases that cover the OPNFV platform functionality testing including pass/fail criteria.
Test software and scripts for testing OPNFV Platform functionality that is essentially broken down into two main suites as follows:
Automated Test Framework based on Tempest/Robot/Jenkins, with necessary scripts and tools to automatically test and verify OPNFV functionality
Proposed Release Schedule