This is an old revision of the document!
Key objectives:
Pad dedicated to func test: https://etherpad.opnfv.org/p/functiontestrelease1activities
IRC chan: #opnfv-testperf
Procedure shall be independant from the installer. The procedure shall be performed on any of the installer.
TODO: shall we be more prescritive on the toloing environment (creation of the VM, installation of the tools)?
for release 1 we target the automation of the following tests
List of testcases can be found here
The default scenario are:
the first ones (authenticate, nova, cinder, glance, keystone, neutron, quotas, requests, tempest-do-not-run-against-production) can be re-used. However scenario shall be tuned especially for the bench
Note: during first manual launched on alpha Orange platform installed with opensteak installer, there were lots of errors (196) running Tempest scenario and some in Rally scenario (results to be analyzed)
Studies on the testcase shall be done
To be discussed with CI team asap
Jira ref | Documentation | Manual test | Result analysis | Automated test | BGS link | Comments | |
---|---|---|---|---|---|---|---|
Rally Bench | https://jira.opnfv.org/browse/FUNCTEST-1 | installation procedure described https://github.com/Orange-OpenSource/opnfv/blob/master/docs/TEST.md | OK | Installed on Jump host server of Intel POD 2 #1; Rally natively integrated in Fuell #2;Tested with opensteack #3; | Morgan. Tempest not working on POD - same issue than on #3, patch applied but seems there is a pb ⇒ contact openstack-rally. Rally Test suite can be performed but flavours, images are missing on Openstack SUT deployed on POD 2 | ||
Tempest | https://jira.opnfv.org/browse/FUNCTEST-2 | OK | Use of khalisi for foreman/puppet #1; Rally natively integrated in Fuell #2;Tested with opensteack #3; | ||||
vPing | https://jira.opnfv.org/browse/FUNCTEST-3 | Sama | |||||
vIMS | https://jira.opnfv.org/browse/FUNCTEST-4 | Based on Clearwater solution | Martin | ||||
ODL | https://jira.opnfv.org/browse/FUNCTEST-5 | Peter ⇒ https://etherpad.opnfv.org/p/robotframework |